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Preface 



These lecture notes on differential equations are based on my experience 
teaching Math 280 and Math 351 at California State University, Northridgc 
since 2000. The content of Math 280 is more applied (solving equations) 
and Math 351 is more theoretical (existence and uniqueness) but I have 
attempted to integrate the material together in the notes in a logical order 
and I select material from each section for each class. 

The subject matter is classical differential equations and many of the excit- 
ing topics that could be covered in an introductory class, such as nonlinear 
systems analysis, bifurcations, chaos, delay equations, and difference equa- 
tions are omitted in favor of providing a solid grounding the basics. 

Some of the more theoretical sections have been marked with the traditional 
asterisk*. You can't possibly hope to cover everything in the notes in a 
single semester. If you are using these notes in a class you should use them 
in conjunction with one of the standard textbooks (such as [2], [9] or [12] for 
all students in both 280 and 351, and by [5] or [11] for the more theoretical 
classes such as 351) since the descriptions and justifications are necessarily 
brief, and there are no exercises. 

The current version has been typeset in I^Tj^X and many pieces of it were 
converted using file conversion software to convert earlier versions from 
various other formats. This may have introduced as many errors as it 
saved in typing time. There are probably many more errors that haven't 
yet been caught so please let me know about them as you find them. 

While this document is intended for students in my classes at CSUN you 
are free to use it and distribute it under the terms of the Creative Com- 
mons Attribution - Non-commercial - No Derivative Works 3.0 United 
States license. If you discover any bugs please let me know. All feedback, 
comments, suggestions for improvement, etc., are appreciated, especially if 
you've used these notes for a class, either at CSUN or elsewhere, from both 
instructors and students. 
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PREFACE 



The art work on page i was drawn by D. Meza; on page iv by T. Addc; 
on page vi by R. Miranda; on page 10 by C. Roach; on page 116 by M. 
Ferreira; on page 204 by W. Jung; on page 282 by J. Peha; on page 330 
by J. Guerrero-Gonzalez; on page 419 by S. Ross; and on page 421 by N. 
Joy. Additional submissions are always welcome and appreciated. The less 
humorous line drawings were all prepared by the author in Mathematica or 
Inkscape. □ 



Lesson 1 



Basic Concepts 



A differential equation is any equation that includes derivatives, such as 

dy 



dt y (L1) 



or 

-,2 



'^ + < 1 -HiJ =e (L2) 

There are two main classes of differential equations: 

• ordinary differential equations (abbreviated ODES or DES) are 

equations that contain only ordinary derivatives; and 

• partial differential equations (abbreviated PDES) are equations 
that contain partial derivatives, or combinations of partial and ordi- 
nary derivatives. 

In your studies you may come across terms for other types of differen- 
tial equations such as functional differential equations, delay equations, 
differential-algebraic equations, and so forth. In order to understand any 
of these more complicated types of equations (which we will not study this 
semester) one needs to completely understand the properties of equations 
that can be written in the form 

% = mv) (i.3) 

where f(t,y) is some function of two variables. We will focus exclusively 
on equations of the form given by equation 1.3 and its generalizations to 
equations with higher order derivatives and systems of equations. 
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LESSON 1. BASIC CONCEPTS 



Ordinary differential equations are further classified by type and degree. 
There are two types of ODE: 

• Linear differential equations arc those that can be written in a 
form such as 

a n {t)y {n) + o B _i(t)»( n - 1 ' + • • • + a 2 (t)y" + ai (t)y> + a 0 (t) = 0 (f .4) 

where each cn(t) is either zero, constant, or depends only on t, and 
not on y. 

• Nonlinear differential equations are any equations that cannot be 
written in the above form. In particular, these include all equations 
that include y, y 1 , y", etc., raised to any power (such as y 2 or (?/)); 
nonlinear functions of y or any derivative to any order (such as sin(y) 
or e* y ; or any product or function of these. 

The order of a differential equation is the degree of the highest order 
derivative in it. Thus 

y'" -'Sty 2 = sini (1.5) 

is a third order (because of the y'") nonlinear (because of the y 2 ) differential 
equation. We will return to the concepts of degree and type of ODE later. 

Definition 1.1 (Standard Form). A differential equation is said to be 
in standard form if we can solve for dy/dx, i.e., there exists some function 
f(t, y) such that 

§ = /(*,*) (1.6) 

We will often want to rewrite a given equation in standard form so that we 
can identify the form of the function f(t, y). 

Example 1.1. Rewrite the differential equation t 2 y'+3ty = yy' in standard 
form and identify the function f(t, y). 

The goal here is to solve for y': 

2 y 

(t 2 - y)y' = -Sty 
Sty 



t 2 y' - yy' = sty 



y = 

hence 



y-t 2 



(1.7) 
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Definition 1.2 (Solution, ODE). A function y = cf>(t) is called a solution 
of y' = f(t,y) if it satisfies 

4>'{t) = f{tA{t)) (1-9) 

By a solution of a differential equation we mean a function y(t) that sat- 
isfies equation 1.3. We use the symbol 4>(t) instead of f(t) for the solution 
because / is always reserved for the function on the right-hand side of 1.3. 

To verify that a function y = f(t) is a solution of the ODE, is a solution, 
we substitute the function into both sides of the differential equation. 



Example 1.2. A solution of 



|= 31 (1,0, 



y = \i' (i.n) 

We use the expression "a solution" rather than "the solution" because so- 
lutions are not unique! For example, 

y = |t 2 + 27 (1.12) 

is also a solution of y' = 3t. We say that the solution is not unique. □ 
Example 1.3. Show 1 that y = x 4 /16 is a solution of y' = xy 1 ^ 2 
Example 1.4. Show 2 that y = xe x is a solution of y" — 2y' + y = 0. 
Example 1.5. We can derive a solution of the differential equation 

by rewriting it as 

d y = dt (i.i4) 

y 

and then integrating both sides of the equation: 

J d f=Jdt (1.15) 

1 Zill example 1.1.1(a) 
2 Zill example 1.1.1(b) 
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LESSON 1. BASIC CONCEPTS 



From our study of calculus we know that 

^-=ln\y\ + C (1.16) 
and 

1 dt = t + C (1.17) 

where the C's in the last two equations are possibly different numbers. We 
can write this as 

In |y| +d =t + C 2 (1.18) 

or 

)n\y\=t + C 3 (1.19) 

where C3 = C2 — C\. 

In general when we have arbitrary constants added, subtracted, multiplied 
or divided by one another we will get another constant and we will not 
distinguish between these; instead we will just write 

ln\y\=t + C (1.20) 

It is usually nice to be able to solve for y (although most of the time we 
won't be able to do this). In this case we know from the properties of 
logarithms that a 

\V\ = e t+C = e c e* (1.21) 

Since an exponential of a constant is a constant, we normally just replace e 
with C, always keeping in mind that that C values are probably different: 

\y\ = Ce l (1.22) 

We still have not solved for y; to do this we need to recall the definition of 
absolute value: 

Thus we can write 





if y > 0 


I -v 


if y < 0 


Ce* 


if y > 0 


-Ce* 


if y < 0 



y=\ -Ce* if^O ^ 

But both C and — C are constants, and so we can write this more generally 
as 

y = Ce 1 (1.25) 

So what is the difference between equations 1.22 and 1.25? In the first case 
we have an absolute value, which is never negative, so the C in equation 
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1.22 is restricted to being a positive number or zero, in the second case 
(equation 1.25) there is no such restriction on C, and it is allowed to take 
on any real value. □ 

In the previous example we say that y — Ce*, where C is any arbitrary 
constant is the general solution of the differential equation. A constant 
like C that is allowed to take on multiple values in an equation is sometimes 
called a parameter, and in this jargon we will sometimes say that y = Ce* 
represents the one-parameter family of solutions (these are sometimes 
also called the integral curves or solution curves) of the differential 
equation, with parameter C. We will pin the value of the parameter down 
more firmly in terms of initial value problems, which associate a specific 
point, or initial condition, with a differential equation. We will return 
to the concept of the one-parameter family of solutions in the next section, 
where it provides us a geometric illustration of the concept of a differential 
equation as a description of a dynamical system. 

Definition 1.3 (Initial Value Problem (IVP)). An initial value prob- 
lem is given by 



where (to,yo) be a point in the domain of f(t,y). Equation 1.27 is called 
an initial condition for the initial value problem. 

Example 1.6. The following is an initial value problem: 



Definition 1.4 (Solution, IVP). The function cf>(t) is called a solution 
of the initial value problem 



dy 



f(t,y) 



(1.26) 
(1.27) 



dt v 

y(to) = yo 




(1.28) 



□ 




(1.29) 



if <fi(t) satisfies both the ODE and the IC, i.e., d<f>/dt = f(t,<fi(t)) and 
<f>(ta) = yo- 
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LESSON 1. BASIC CONCEPTS 



Example 1.7. The solution of the IVP given by example 1.6 is given by 
equation 1.12, which you should verify. In fact, this solution is unique, 
in the sense that it is the only function that satisfies both the differential 
equation and the initial value problem. □ 

Example 1.8. Solve the initial value problem dy/dt = t/y , y(l) = 2. 
We can rewrite the differential equation as 



ydy = tdt (1.30) 



and then integrate, 



ydy = J tdt (1.31) 
\y 2 = -t 2 +C (1.32) 

2 y 

When we substitute the initial condition (that y — 2 when t = 1) into the 
general solution, we obtain 

l -{2f= l -{lf + C (1.33) 

Hence C = 3/2. Substituting back into equation 1.32 and multiplying 
through by 2, 

y 2 =i 2 + 3 (1.34) 

Taking square roots, 

y = Vt 2 + 3 (1.35) 

which we call the solution of the initial value problem. The negative square 
root is excluded because of the initial condition which forces y(l) = 2. □ 



Not all initial value problems have solutions. However, there are a large 
class of IVPs that do have solution. In particular, those equations for 
which the right hand side is diffcrcntiablc with respect to y and the partial 
derivative is bounded. This is because of the following theorem which we 
will accept without proof for now. 

Theorem 1.5 (Fundamental Existence and Uniqueness Theorem). 

Let f(t, y) be bounded, continuous and differentiable on some neighborhood 
R of (t 0 ,yo), and suppose that df/dy is bounded on R. Then the initial 
value problem 1.29 has a unique solution on some open neighborhood of 
(to,Vo)- 
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Figure 1.1 illustrates what this means. The initial condition is given by 
the point (to,yo) (the horizontal axis is the i-axis; the vertical axis is y). If 
there is some number M such that \df /dy\ < M everywhere in the box R, 
then there is some region N where we can draw the curve through (t 0 , j/o)- 
This curve is the solution of the IVP. 3 

Figure 1.1: Illustration of the fundamental existence theorem. If / is 
bounded, continuous and differentiable in some neighborhood R of (t 0 , Rq), 
and the partial derivative dfdy is also bounded, then there is some (pos- 
sibly smaller) neighborhood of (to 7 Ro) through which a unique solution to 
the initial value problem, with the solution passing through (to,yo), exists. 
This does not mean we are able to find a formula for the solution. 



II 




A solution may be either implicit or explicit. A solution y — <j>(t) is said 
to be explicit if the dependent variable (y in this case) can be written 
explicitly as a function of the independent variable (t, in this case). A 
relationship F(t, y) = 0 is said to represent and implicit solution of the 
differential equation on some interval / if there some function cj)(t) such 
that F(t, 4>(t)) = 0 and the relationship F(t, y) — 0 satisfies the differential 
equation. For example, equation 1.34 represents the solution of {dy/dt = 
t/y, y(l) = 2} implicitly on the interval I = [— y/3] which (1.35) is an 
explicit solution of the same initial value problem problem. 



3 We also require that |/| < M everywhere on R and that / be continuous and 
diflercntiable. 
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Example 1.9. Show that y = e xy is an implicit solution of 

dy ^ y 2 
dx 1 — xy 



(1.36) 



To verify that y is an implicit solution (it cannot be an explicit solution 
because it is not written as y as a function of x), we differentiate: 

£-«■"■ < L37) 

= y (x^ + y^j (substV = e xy ) (1.38) 

= yx Tx +y2 (L39) 

%- yx tx= y 2 (L40) 

f x {l -yx)=y 2 (1.41) 



dy y 



2 



1 — yx 



□ (1.42) 



Definition 1.6 (Order). The order (sometimes called degree) of a differ- 
ential equation is the order of the highest order derivative in the equation. 



Example 1.10. The equation 

d " ] ' M = y/t (1.43) 



dt i 

is first order, because the only derivative is dy/dt, and the equation 

V + 4y' + y = -5t 2 (1.44) 
is second order because it has a second derivative in the first term. 

Definition 1.7 (Linear Equations). A linear differential equation is a 
DE that only contains terms that are linear in y and its derivatives to all 
orders. The linearity of t does not matter. The equation 

y + 5y' + 17t 2 y" = sint (1.45) 

is linear but the following equations are not linear: 

y + 5t 2 sin y = y" (because of sin y) 

y' + ty" + y = y 2 (because of y 2 ) (1.46) 

yy' = 5t (because of yy') 
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We will study linear equations in greater detail in section 4. 

Often we will be faced with a problem whose description requires not one, 
but two, or even more, differential equations. This is analogous to an 
algebra problem that requires us to solve multiple equations in multiple 
unknowns. A system of differential equations is a collection of re- 
lated differential equations that have multiple unknowns. For example, the 
variable y(t) might depend not only on t and y(t) but also on a second 
variable z(t), that in turn depends on y(t). For example, this is a system of 
differential equations of two variables y and z (with independent variable 



It is because of systems that we will use the variable t rather than x for the 
horizontal (time) axis in our study of single ODEs. This way we can have 
a natural progression of variables x(t), y(t), z(t), . . . , in which to express 
systems of equations. In fact, systems of equations can be quite difficult 
to solve and often lead to chaotic solutions. We will return to a study of 
systems of linear equations in a later section. 



t): 




(1.47) 
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Lesson 2 



A Geometric View 



One way to look at a differential equation is as a description of a trajectory 
or position of an object over time. We will steal the term "particle" from 
physics for this idea. By a particle we will mean a "thing" or "object" (but 
doesn't sound quite so coarse) whose location at time t = t n is given by 

V = 2/o (2.1) 
At a later time t > to we will describe the position by a function 

y = m (2.2) 

which we will generally write as y(f) to avoid the confusion caused by the 
extra Greek symbol. 1 We can illustrate this in the following example. 

Example 2.1. Find y(t) for all f > 0 if dy/dt = y and y(0) = 1. 

In example 1.5 we found that the general solution of the differential equation 
is 

y = Ce l (2.3) 

We can determine the value of C from the initial condition, which tells us 
that y = 1 when t = 1: 

1 = y(0) = Ce° = C (2.4) 
Hence the solution of the initial value problem is 

y = e t (2.5) 

1 Mathematically, we mean that (f>(t) is a solution of the equations that describes what 
happens to y as a result of some differential equation dy/dt = f(t,y); in practice, the 
equation for <f>(t) is identical to the equation for y(t) and the distinction can be ignored. 
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LESSON 2. A GEOMETRIC VIEW 



We can plug in numbers to get the position of our "particle" at any time 
t: At t = 0, y = e° = 1; at t = 0.1, y = e<0.1) «= 1.10517; at t = 0.2, 
y = e 0 2 s» 1.2214; etc. The corresponding "trajectory" is plotted in the 
figure 2.1. □ 



Figure 2.1: Solution for example 2.1. Here the y axis gives the particle 
position as a function of time (the t or horizontal axis. 



1.3 
1.2 
1.1 
1. 



0.9 1 









v^i (0.2, e 0 - 2 ) 






(0,1} 









0.1 



0. 



0.1 

t 



0.2 



0.3 



Since the solution of any (solvable 2 ) initial value problem dy/dt — f(t,y), 
y(to) — J/o is given by some function y = y(t), and because any function 
y = y(t) can be interpreted as a trajectory, this tells us that any initial value 
problem can be interpreted geometrically in terms of a dynamical (moving 
or changing) system. 3 We say "geometrically" rather than "physically" 
because the dynamics may not follow the standard laws of physics (things 
like F = ma) but instead follow the rules defined by a differential equation. 
The geometric (or dynamic) interpretation of the initial value problem y' — 
y, 2/(0) = 1 given in the last example is is described by the plot of the 
trajectory (curve) of y(t) as a function of t. 



2 By solvable we mean any I VP for which a solution exists according to the funda- 
mental existence theorem (theorem 1.5). This does not necessarily mean that we can 
actually solve for (find) an equation for the solution. 

3 We will use the word "dynamics" in the sense that it is meant in mathematics 
and not in physics. In math a dynamical system is anything that is changing in 
time, hence dynamic. This often (though not always) means that it is governed by 
a differential equation. It does not have to follow the rules of Newtonian mechanics. 
The term "dynamical system" is frequently bandied about in conjunction with chaotic 
systems and chaos, but chaotic systems are only one type of dynamics. We will not 
study chaotic systems in this class but all of the systems we study can be considered 
dynamical systems. 
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We can extend this geometric interpretation from the initial value problem 
to the general solution of the differential equation. For example we found in 
example 1.5 that y — Ce* is the solution to the ODE y' = y, and we called 
the expression the one-parameter family of solutions. To see what this 
means consider the effect of the initial condition on y = Ce* : it determines 
a specific value for C. In fact, if we were to plot every conceivable curve 
y = Ce' (for every value of C) , the picture would look something like those 
shown in figure 2.2 The large black dot indicates the location of the point 




(0, 1), and the values of C are shown for several of the curves. 4 We see that 
the curve corresponding to C = 1.0 is the only curve that passes through 
the point (0, 1) - this is a result of the uniqueness of the solutions. As long 
the conditions of the fundamental theorem (theorem 1.5) are met, there 
is always precisely one curve that passes through any given point. The 
family (or collection) of curves that we see in this picture represents the 
one-parameter family of solutions: each member of the family is a different 
curve, and is differentiated by its relatives by the value of C, which we call 
a parameter. Another term that is sometimes used for the one-parameter 
family of solutions is the set of integral curves. 



4 In fact, not all curves are shown here, only the curves for C = 
. , —.5, 0, 0.5, 1, 1.5, .... Curves for other values fall between these. 
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LESSON 2. A GEOMETRIC VIEW 



Example 2.2. Find and illustrate the one-parameter family of solutions 
for the ODE 



dy _ _t 
dt y 



Cross multiplying and integrating 



ydy 



tdt 



(2.6) 



(2.7) 



\v 2 = -\t 2 + c 



(2. 



Multiplying through by 2, bringing the t to the left hand side and redefining 
C = 2C gives us 

y 2 +t 2 = C 2 (2.9) 

which we (should!) recognize as the equation of a circle of radius C. The 
curves for several values of C = 1, 2, . . . is illustrated in figure 2.3. □ 

Figure 2.3: One parameter family of solutions for example 2.2. 




6543210123456 



Sometimes its not so easy to visualize the trajectories; a tool that gives us 
some help here is the direction field. The direction field is a plot of the 
slope of the trajectory. We know from the differential equation 



(2.10) 
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that since the slope of the solution y{t) at any point is dy/dt, and since 
dy/dt — /, then the slope at (t,y) must be equal to f(t,y). We obtain the 
direction held but dividing the plane into a hxed grid of points Pi = (ti, iji) 
and then then drawing a little arrow at each point Pi with slope f(t i: yi). 
The lengths of all the arrows should be the same. The general principal is 
illustrated by the following example. 



Example 2.3. Construct the direction held of 



dy 
dt 



y 



(2.11) 



on the region — 3 < t < 3, — 3 < y < 3, with a grid spacing of 1. 

First we calculate the values of the slopes at different points. The slope is 
given by f(t, y) — t 2 — y. Several values are shown. 



t 


V = -3 


y = -2 


y = -l 


y = o 


y = l 


y = 2 


y = 3 


t = -3 


12 


11 


10 


9 


8 


7 


6 


t = -2 


7 


6 


5 


4 


3 


2 


1 


t = -1 


4 


3 


2 


1 


0 


-1 


-2 


t = 0 


3 


2 


1 


0 


-1 


-2 


-3 


t = 1 


4 


3 


2 


1 


0 


-1 


-2 


t = 2 


7 


6 


5 


4 


3 


2 


1 


t = 3 


12 


11 


10 


9 


8 


7 


6 



The direction held with a grid spacing of 1, as calculated in the table 
above, is shown in hgure 2.4 on the left. 0 At each point, a small arrow is 
plotted. For example, an arrow with slope 6 is drawn centered on the point 
(-3,3); an arrow with slope 1 is drawn centered on the point (-2, 3); and so 
forth. (The values are taken directly with the table). A direction held of 
the same differential equation but with a hner spacing is illustrated in hg 
2.4 on the right. From this plot we can image what the solutions may look 
like by constructing curves in our minds that are tangent to each arrow. 

Usually it is easier if we omit the arrows and just draw short lines on the 
grid (see hgure 2.5, on the left 6 ). The one-parameter family of solutions is 
illustrated on the right. 7 □ 



5 The direction field can be plotted in Mathematica using f [t_, y_] := t'2 - y; 
VectorPlot[{l, f[t, y] }/Norm[{l , f[t, y]}], {t, -3, 3}, {y, -3, 3}]. The nor- 
malization ensures that all arrows have the same length. 

6 In Mathematica: f [t_, y_] := t~2 - y; followed by v[t_, y_, f_] : = 
0. l*{Cos[ArcTan[f [t, y]]], Sin[ArcTan[f [t, y]]]}; L[t_, y_, f_] := Line[{{t, 
y - v[t, y, f], {t, y} + v[t, y, f]}]; Graphics[Table[L[t, y, f], {t, -3, 3, .2}, {y, -3, 3, .2}]] 

7 The analytic solution y = e~ t (e*t 2 - 2eH + 2e* - e to t 0 2 + e'oyo - 2e'° + 2e*°to) 
was used to generate this plot. The solution can be found in Mathematica via 
DSolve[{y' [t] == t~2 - y [t] , y[t0] == y0} , y[t], t] . 
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LESSON 2. A GEOMETRIC VIEW 



Figure 2.4: Direction fields with arrows. See text for details. 
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■■HUmv 



at 

1 0 



Figure 2.5: Direction fields with short lines (left) and one parameter family 
of solutions (right) for (2.11). 



Lesson 3 

Separable Equations 



An ODE is said to be separable if the parts that depend on t and y can 
be separated to the different sides of the equation. This makes it possible 
to integrate each side separable. 1 Specifically, an equation is separable if it 
can be written is 

f = a(t)b(v) (3-1) 

for some function a(t) that depends only on t, but not on y, and some 
function b(y) that depends only on y and and not on t. If we multiply 
through by dt and divide by b(y) the equation becomes 

^ = a(t)dt (3.2) 

so we may integrate: 

wrl am (3 - 3) 

We have already seen many separable equations. Another is given in the 
following example. 



Example 3.1. 



dy f-. t 



.2 



dt V 1 2 / } C-U) 
1/(0) = 1 



1 In this section of the text, Boyce and DiPrima have chosen to use x rather than t as 
the independent variable, probably because it will look more like exact two-dimensional 
derivatives of the type you should have seen in Math 250. 
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This equation is separable with 

i(t) = 1 - 



o(t) = 1 - * (3.5) 



and 

b(y) = y 2 (3.6) 

and it can be rewritten as 



n .2 



1 - - ) dt (3.7) 



Integrating, 



J y~ 2 dy = J (l - 0 dt (3.8) 

--=t--t 2 + C (3.9) 
2/4 

The initial condition gives 

-l = 0-0 + C (3.10) 

hence 

- = X ~f - t + 1 = \(t 2 - 4i + 4) = \(t - 2) 2 (3.11) 
?/4 4 4 

Solving for y, 

y = J ^ w □ (3-i2) 

Often with separable equations we will not be able to find an explicit ex- 
pression for y as a function of t; instead, we will have to be happy with an 
equation that relates the two variables. 



Example 3.2. Find a general solution of 

dy t 



(3.13) 



dt ev - 2y 
This can be rearranged as 

(e y - 2y)dy = tdt (3.14) 

Integrating, 

J (e v - 2y)dy = J tdt (3.15) 

e y - y 2 = \t 2 + C (3.16) 
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Since it is not possible to solve this equation for y as a function of t, is is 
common to rearrange it as a function equal to a constant: 



y 2 ~h 2 = c 

y 2 



□ 



(3.17) 



Sometimes this inability to find an explicit formula for y(t) means that the 
relationship between y and t is not a function, but is instead multi-valued, 
as in the following example where we can use our knowledge of analytic 
geometry to learn more about the solutions. 



Example 3.3. Find the general solution of 

dy _ At 
~di ~ ~9y 

Rearranging and integrating: 



9ydy 
9 , 



Atdt 



-2t 2 + C 
9y 2 + At 2 = C (Different C) 



Dividing both sides by 36, 

2 



4 



t 2 

-=C 
9 



(Different C) 



Dividing by C 



y_ 

AC 



9C 



(3.18) 



(3.19) 

(3.20) 
(3.21) 



(3.22) 



(3.23) 



which is the general form of an ellipse with axis 2\JC parallel to the y 
axis and axis 3vC parallel to the y axis. Thus the solutions are all el- 
lipses around the origin, and these cannot be solved explicitly as a function 
because the formula is multi-valued. □ 



Example 3.4. Solve 2 (1 + x)dy — ydx — 0. Ans: y = c(l + x) 
Example 3.5. Solve 3 



□ 



Ans: 



2/ = 2 



dx 



1 - Ce 4 



y 2 -A 



or y = ±2 □ 



(3.24) 
(3.25) 



2 Zill Example 2.2.1 
3 Zill Example 2.2.3 
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Example 3.6. Solve 4 

(e 2y - y) cosx = e y sin 2x, y(0) = 0 (3.26) 
ax 

Ans: 

e y + ye- y + e~ y = 4 - 2 cos x □ (3.27) 
Example 3.7. Solve 5 

~=e-*\ y(3) = 5 (3.28) 

Ans: 

/•X 

y(x) = 5 + y e -i dt □ (3.29) 
Definition 3.1. The Error Function erf(x) is defined as 

2 /"^ 2 

erf(x) = -= e~ e dt (3.30) 
V 71 " ./o 

A plot of erf(x) is given in figure 4.2. 

Example 3.8. Rewrite the solution to example 3.7 in terms of erf(x) 

y (x) = 5 + ^—{<sd(x) - erf(3)) □ (3.31) 

Sometimes it is not so easy to tell by looking at an equation if it is separable 

because it may need to be factored before the variables can be separated. 

There is a test that we can use that will sometimes help us to disentangle 
these variables. To derive this test, we will rearrange the general separable 
equation as follows 

f = a(t)b(v) (3-32) 

t^t = a(t)dt (3.33) 

b[y) 

- a(t)dt = 0 (3.34) 

b{y) 

N(y)dy + M(t)dt = 0 (3.35) 



4 Zill Example 2.2.4 
5 Zill Example 2.2.5 



21 



where M(t) = —a(t) and N(y) = l/b(y) are new names that we give our 
functions. This gives us the standard form for a separable equation 



M{t)dt + N(y)dy = 0 (3.36) 



The cross-derivative is 



Hence 

ffty = 



(3.37) 



The reason for calling this the standard format will become more clear when 
we study exact equations. To continue deriving our test for separability we 
rearrange 3.36 as 

dy = M(t) 
It N(y) 

Recalling the standard form of an ordinary differential equation 

f = /(*.») ( 3 - 38 ) 

we have 

f(t,y) = -^| (3-39) 

Since M is only a function of t, 

dM ,. . dM dM 

-w = 1 *® = -w> ~w = ° (3 ' 40) 

and because N is only a function of y, 
Similarly 

>>=%-w> 



a 2 / _ AJ'(f)JY'(y) 
" my" WW~ { ' 



M(t)\ ( M'(t)N'(y) \ 

m) I ^ (y ) j (3 - 45) 

(3.46) 



M'(t) \ ( M(t)N'(yY 
N(y) ) \ N*(y) 
= ftfy (3.47) 
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In other words, the equation y' = f(t, y) is separable if and only if 



f(t,y) 



dtdy dt dy 



l + t 2 + y 3 + t 2 y 3 



Hence 



9/ 
dy 



(3.48) 



(3.49) 



Example 3.9. Determine if 

dy 
dt 

is separable. 

From the right hand side of the differential equation we see that 

f(t,y) = 1 + t 2 +y 3 +t 2 y 3 (3.50) 
Calculating all the necessary partial derivatives, 

^ = 2t + 2ty 3 (3.51) 

3y 2 + 3t 2 y 2 (3.52) 



and 



dfdf 
dt dy 



f(t,y) 



d 2 .f 

dtdy 



(2t + 2ty 3 ) (3y 2 + M 2 y 2 ) 
6ty 2 + 6t 3 y 2 + 6ty 5 + 6t 3 y 5 

(l + t 2 +y 3 + t 2 y 3 ) 6ty 2 



= 6ty 2 + 6t 3 y 2 + 6ty 5 + 6t 3 y 5 

= WW 
dt dy 

Consequently the differential equation is separable. □ 



(3.53) 
(3.54) 

(3.55) 
(3.56) 
(3.57) 



Of course, knowing that the equation is separable does not tell us how to 
solve it. It does, however, tell us that looking for a factorization of 

f(t,y) = a(t)b(y) (3.58) 

is not a waste of time. In the previous example, the correct factorization is 



dy 
dt 



(l + y 3 )(l + t 2 ) 



(3.59) 
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Example 3.10. Find a general solution of 

"" = 1 + t 2 +y 3 + t 2 y 3 (3.60) 



dt 

From (3.59) we have 

''" (i + y 3 )(i + t 2 ) (3.61) 



dt 

hence the equation can be re-written as 

dy 



1 + ^3= J^ + ndt (3.62) 

The integral on the left can be solved using the method of partial fractions: 

1 = 1 = _±_ By + C 

l + y 3 (y + l)(y 2 - y + 1) l + y y 2 - y + 1 

Cross-multiplying gives 

l = A(y 2 -y + l) + (By + C)(l + y) (3.64) 
Substituting y = — 1 gives 

1 = A{1 + 1 + 1) =>> A = \ (3.65) 

Sbstituting y = 0 

1 = A(0 - 0 + 1) + (0 + C)(l + 0) = i + C (3.66) 



Using y = 1 



Hence 



1 = A(l - 1 + 1) + (-B(l) + C)(l + 1) = \ + 2B + - (3.67) 



^ = 1-1 = -! => fl = -I (3.68) 
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Thus 

dy _ 1 f dy , f (-1/3), + 2/3^ (3 ^ 



1 + y 3 3j l + y J y 2 - y + 1 



(3.70) 



1 If ydy 

= 3 ln|1 + y| -3i (j/ -V2) 2 + 3/4 + 

+ ^/(y-l/2)2 + 3/4 (3J3) 

= 1 In |1 + y| - 1 In |y 2 - y + 1| + ^tan" 1 V —^- (3.74) 

= lln|l + y|-iln|y 2 -y + l| + 3 l ! tan- 12 ^ (3.75) 

Hence the solution of the differential equation is 

Ilnll + yl-lln^-y + ll + ^tan" 1 ^-*- \t* = C (3.76) 



Lesson 4 



Linear Equations 



Recall that a function y is linear in a variable x if it describes a straight 
line, e.g., we write something like 

y = Ax + B (4.1) 

to mean that y is linear in a;. If we have an algebraic system that depends 
on t, we might allow A and B to be functions of t, e..g, the equation 

y = A{t)x + B(t) (4.2) 

is also linear in x. For example, Recall that a function is linear in a 

y = t 2 x + isa\t (4.3) 

is linear in x because for any fixed value oft, it has the form 

y = Ax + B (4.4) 

Thus to determine the linearity of a function in x, the nature of the depen- 
dence on any other variable does not matter. The same definition holds for 
differential equations. 

By a linear differential equation we mean a differential equation of 
a single variable, say y(t), whose derivative depends on itself only 
linearly. The nature of the dependence on the time variable does not 
matter. From our discussion above, something is linear in x if it is written 
as 

Ax + B (4.5) 
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where A and B do not depend on x. Hence something is linear in y if it 
can be written as 

Ay + B (4.6) 

if A and B do not depend on y. Thus for a differential equation to be linear 
in y it must have the form 

f t =Ay + B (4.7) 

where neither A nor B depends on y. However, both A and B are allowed 
to depend on t. To emphasize this we write the terms A and B as A(t) 
and B(t), so that the linear equation becomes 

d Ji=A(t)y + B(t) (4.8) 

For convenience of finding solutions (its not clear now why this is conve- 
nient, but trust me) we bring the term in A(t)y to the left hand side of the 
equation: 

f t -A(t)y = B(t) (4.9) 

To be consistent with most textbooks on differential equations we will re- 
label A(t) = —p(t) and B{t) = q(t), for some function p{t) and q(t), and 
this gives us 



^+p(t)y = q(t) 



(4.10) 



which we will refer to as the standard form of the linear ODE. Sometimes 
for convenience we will omit the t (but the dependence will be implied) on 
the p and q and write the derivative with a prime, as 

y'+py = q (4.11) 



There is a general technique that will always work to solve a first order 
linear ODE. We will derive the method constructively in the following para- 
graph and then give several examples of its use. The idea is look for some 
function /j,(t) that we can multiply both sides of the equation: 

H x (y' + py) = fj, x q (4.12) 



or 



fiy' + iipy = fiq 



(4.13) 
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So far any function /i will work, but not any function will help. We want 
to find an particular function /j, such that the left hand side of the equation 
becomes 

= /V + fxpy = m (4.14) 
The reason for looking for this kind of /i is that if we can find n then 



Multiplying both sides by dt and integrating gives 



-^{t)y)dt = j n{t)q{t)dt 



(4.15) 
(4.16) 



Since the integral of an exact derivative is the function itself, 

H(t)y= ( fi(t)q(t)dt + C (4.17) 



hence dividing by n, we find that if we can find /i to satisfy equation 
4.14 then the general solution of equation 4.10 is 



1 



V 



n(t)q{t)dt + C 



(4.18) 



So now we need to figure out what function /j,(t) will work. From the 
product rule for derivatives 

d 



dt 



(fiy) = fiy' + n'y 



(4.19) 



Comparing equations 4.14 and 4.19, 

fj,y' + fi'y = fiy' + fipy (4.20) 

H'y = fipy (4.21) 

fi' = fip (4.22) 

Writing // = d\ijdt we find that we can rearrange and integrate both sides 
of the equation: 

~dt 
dji 

A* 

1 



MP 
pdt 



-d/j, 
H 

ln/x 



pdt 
pdt + C 



(4.23) 
(4.24) 
(4.25) 
(4.26) 
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Exponentiating both sides of the equation 



pdt + C / pdt / pdt 

H = eJ = eJ e c = C x eJ (4.27) 

where C\ = e c and C is any constant. Since we want any function /i that 
will work, we are free to choose our constant arbitrarily, e.g., pick C — 0 
hence C% = 1, and we hnd that 



ji(f) 



p(t)dt 



(4.28) 



has the properties we desire. We say the equation 4.28 is an integrating 
factor for the differential equation 4.10. Since we have already chosen 
the constant of integrate, we can safely ignore the constant of integration 
when integrating p. To recap, the general solution of y' +py = q is given by 
equation 4.18 whenever /j, is given by 4.28. The particular solution of a given 
initial value problem involving a linear ODE is then solved by substituting 
the initial condition into the general solution obtained in this manner. 

It is usually easier to memorize the procedure rather than the formula for 
the solution (equation 4.18): 



Method to Solve y' +p(t)y = q(t) 

1. Computer [i = e^ p ^ dt and observe that /jf(t) =p{t)fi{t). 

2. Multiply the ODE through by fi(t) giving 

fi{t)y' + n'{t)y = n(t)q(t) 

3. Observe that the left-hand side is precisely (d/dt)(/i(t)y). 

4. Integrate both sides of the equation over t, remembering that 
J(d/dt)(fxy)dt = n(t)y, 



H(t)y = J q{t)ydt + C 

5. Solve for y by dividing through by /i. Don't forget the constant 
on the right-hand side of the equation. 

6. Use the initial condition to find the value of the constant, if this 
is an initial value problem. 
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Example 4.1. Solve the differential equation 

y +2ty = t (4.29) 

This has the form y' + p(t)y = q(t), where p(t) = 2t and q(t) — t. An 
integrating factor is 

fj,(t) = exp(J p(t)dt) = exp (^J 2td?j = (4.30) 

Multiplying equation (4.29) through by the integrating factor n(t) gives 

e t2 (y' + 2ty) =te t (4.31) 

Recall that the left hand side will always end up as the derivative of yfi 
after multiplying through by //; we can also verify this with the product 
rule: 

d / + 2\ .2 ,2 ,2 

- iye 1 J = y'e* + 2te t y = e l (y 1 + 2ty) (4.32) 
Comparing the last two equations tells us that 

ye 1 ) = te* 2 (4.33) 



dt 

Multiply through both sides by dt and integrate: 



— ( ye 1 )dt= I te L dt (4.34) 



The left hand side is an exact derivative, hence 

2 r 2 

ye 1 = te 1 dt + C (4.35) 
The right hand side can be solved with the substitution u = t 2 : 

2 1/" 1 12 

te* dt=- e u du = -e u + C = -e l +C (4.36) 
2 J 2 2 

Combining the last two equations, 

ye t2 = \e t2 + C (4.37) 



Hence we can solve for y, 



y= l - + Cer t2 . □ (4.38) 
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Example 4.2. Solve ty' - y = t 2 e l . 

We first need to put this into standard form y' + p(t)y = q(t). If wc divide 
the differential equation on both sides by t then 

y'-\y = te- 1 (4.39) 

Hence 

p(t) = -\ (4.40) 

An integrating factor is 

fi(t) = cxp ^ -~j;dtj = cxp(-lnt) = exp ^ln ^ = ^ (4-41) 

Multiplying the differential equation (in standard form) through by [i(t), 
: ( V \v\ = (l) (te"*) = e~* (4.42) 



t V t J \t , 

The left hand side is the exact derivative of \xy: 



dt 
Hence 



d d (y\ ty' -y 1 / , y\ 

w = jA-t) = ^^ = -t [ y ~t) (4 - 43) 



dt \t 

Multiplying by dt and integrating 



" (!) = e " <« 4 > 



Since the left hand side is an exact derivative, 

| = J e _ *dt + C = -e-* + C (4.46) 

Solving for y, 



y = -te^ + Ct □ (4.47) 
Example 4.3. Solve the initial value problem 



y +y = cost, y(0) = 1 



(4.48) 
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Since pit) — 1 (the coefficient of y) , an integrating factor is 

'-»(/»•*)-' <« 9 > 

Multiplying the differential equation through by the integrating factor gives 
j ( e * y ) = e * (y' + y) = e* cos t (4.50) 
Multiplying by dt and integrating, 

/ Jt^ ety ^ dt = J efcostdt ^ 4 - 51 ) 

The left hand side is an exact derivative; the right hand side we can find 
from an integral table or WolframAlpha: 



ye* 



J e* cos tdt = ^e t (sin t + cos t) + C (4-52) 



The initial condition tells us that y — 1 when t = 0, 



(l)e° = -e° (sin(0) + cos(0)) + C (4.53) 
l=\ + C (4.54) 
C = i (4.55) 



Substituting C = 1/2 into equation 4.52 gives 



ye* = ie* (sint + cost) + ~ (4.56) 

We can then solve for y by dividing by e*, 

y = i (sint + cost) + ^e"* (4-57) 

which is the unique solution to the initial value problem. □ 
Example 4.4. Solve the initial value problem 



y'-2y = e 7 * 

y(o) = i 



(4.58) 
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The equation is already given in standard form, with p(t) = —2. Hence an 
integrating factor is 

H{t) = cxp ^jf (-2)dtj = e- 2t (4.59) 

Multiply the original ODE by the integrating factor fj,(t) gives 

e- 2t (y / -2y) = (e- 2t )(e 7t ) (4.60) 
Simplifying and recognizing the left hand side as the derivative of fiy, 

j t (ye- 2t ) = e 5t (4.61) 

Multiply by dt and integrate: 

J l( ye - 2t )dt = Je 5t dt (4.62) 

ye~ 2t = \e bt + C (4.63) 



y = \e 7t + Ce 2t (4.64) 



From the initial condition 



1 = \e° + Ce° = I + C (4.65) 

Hence C = 4/5 and the solution is 

y=\e n + \e 2t □ (4.66) 

Example 4.5. Find the general solutions of 

ty' + 4y = 4t 2 (4.67) 

To solve this we first need to put it into standard linear form by dividing 
by t: 

y' + f = 4 ^=4t (4.68) 
Since p(t) — 4/t an integrating factor is 

H = cxp ^ *dtj = cxp (4 hit) = t* (4.69) 
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Multiplying equation 4.68 by fi gives 



d 
dl 



Integrating, 



(t 4 y)=£ 4 (V + y) =(4t)(t 4 ) = 4t 5 (4.70) 

J j t (t 4 y)dt = J 4t 5 dt (4.71) 
t 4 y=^ + C (4.72) 

y = -Y + T* □ ( 4 -73) 

The last example is interesting because it demonstrates a differential equa- 
tion whose solution will behave radically differently depending on the initial 
value. 

Example 4.6. Solve 4.67 with initial conditions of (a) y(l) = 0; (b) y(l) = 
1; and (c) y(l) = 2/3. 

(a) With y(l) = 0 in equation 4.73 



0=<?f + 5 = ? + C ,4.74) 



hence C = —2/3, and 

(b) With = 1, 
hence C = 1/3, and 

(c) With y(l) = 2/3, 
hence C — 0 and 



It 2 2 

" 3 I ^ 

(2)(1) C = 2 
3 1 3 



C (4.76) 



2i 2 1 



2t 2 
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Figure 4.1: Different solutions for example 4.6. 
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The three solutions are illustrated in the figure 4.1. In cases (a) and (b), 
the domain of the solution that fits the initial condition excludes t = 0; but 
in case (c), the solution is continuous for all t. Furthermore, lim t _j.o y is 
radically different in all three cases. With a little thought we see that 

r ex), if 2/(1) > 2/3 
lim y(t) = \ 0, if 2/(1) = 2/3 (4.80) 
I -oo, if 2/(1) < 2/3 

As t —> oo all of the solutions become asymptotic to the curve y = 2t 2 /3. 
The side on of the curved asymptote on which the initial conditions falls 
determines the behavior of the solution for small t. □ 



What if we were given the initial condition y(0) = 0 in the previous exam- 
ple? Clearly the solution y = 2i 2 /3 satisfies this condition, but if we try to 
plug the initial condition into the general solution 

we have a problem because of the C/t 4 term. One possible approach is to 
multiply through by the offending t 4 factor: 



yt* = 2 -t & + C 

3 



(4.82) 



35 



Substituting y = t = 0 in this immediately yields C = 0. This problem 
is a direct consequence of the fact that we divided our equation through 
by t A previously to get an express solution for y(t) (see the transition from 
equation 4.72 to equation 4.73): this division is only allowed when t ^ 0. 

Example 4.7. Solve the initial value problem 




(4.83) 

I J 

Since p(t) = —2t, an integrating factor is 

H = exp (^J -2tdt\ = e~* 2 (4.84) 
Following our usual procedure we get 



If we try to solve the indefinite integral we end up with 



—t" 

ye 



~ t2 dt + C (4.86) 



Unfortunately, there is no exact solution for the indefinite integral on the 
right. Instead we introduce a new concept, of finding a definite integral. 
We will use as our lower limit of integration the initial conditions, which 
means t = 0; and as our upper limit of integration, some unknown variable 
u. Then 

Then we have 

(ye- t2 ) -(ye-**) =^=[ U e- t2 dt (4.88) 

V /t=0 V / t—u V n JO 

Using the initial condition y(0) = 0, the left hand side becomes 

y{u)e- {u ^ - y(0)e'^ 2 = ye"" 2 (4.89) 

hence 

ye~ u2 = -= / e~ t2 dt (4.90) 
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Figure 4.2: The error function, given by equation (4.91). 



1 




— 1 





Note that because of the way we did the integral we have already taken the 
initial condition into account and hence there is no constant C in the result 
of our integration. 

Now we still do not have a closed formula for the integral on the right but it 
is a well-defined function, which is called the error function and written 
as 

erf(i) = ^= [ e~ x2 dx (4.91) 
V 71 " Jo 

The error function is a monotonically increasing S-shaped function that 
passes through the origin and approaches the lines y = ±1 as t — > ±oo, as 
illustrated in figure 4.2. Using equation 4.91 in equation 4.90 gives 

ye~ t2 = erf(t) (4.92) 

and solving for y, 

y = e* 2 crf(t) (4.93) 

The student should not be troubled by the presence of the error function 
in the solution since it is a well-known, well-behaved function, just like an 
exponential or trigonometric function; the only difference is that erf(x) does 
not (usually) have a button on your calculator. Most numerical software 
packages have it built in - for example, in Mathematica it is represented by 
the function Erf [x] . □ 

This last example gives us another algorithm for solving a linear equation: 
substitute the initial conditions into the integral in step (4) of the algorithm 
given on page 28. To see the consequence of this, we return to equation 
4.16, but instead take the definite integrals. To have the integration make 
sense we need to first change the variable of integration to something other 
than t: 
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1 d /•* 

— (fj,{s)y(s))ds = / fi(s)q(a)ds 



Evaluating the integral, 



M(*M*) - M(*oM*o) = / H(s)q(s)d 



(4.94) 



(4.95) 



Solving for gives a general formula for the solution of a linear initial 
value problem: 



y(t) 



M(*o)y(*o) + / ^(s)q(s)ds 

to 



Example 4.8. Use equation 4.96 to solve 

4 

t— + 2y = - sin* 
ere r 

y(7r) = 0 

Rewriting in standard form for a linear differential equation, 

2 4 
2/' + -V = ^sint 

Hence p(t) = 2/t and q(t) — (4/i) 2 sin*. An integrating factor is 

fi(t) = cxp (^J ^dt^j = cxp (2 lnt) = t 2 
Thus equation 4.96 gives us 



vit) - T2 



t 2 



(tt 2 )(0)+ / (s 2 ) -sins ds 



sin s ds 



4(cosi — cos7r) 

~~t 2 
4(cosi + 1) 
^2 



□ 



(4.96) 



(4.97) 

(4.98) 
(4.99) 

(4.100) 
(4.101) 
(4.102) 
(4.103) 
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Lesson 5 



Bernoulli Equations 



The Bernoulli differential equation has the form 

y' +p(t)y = y n q(t) (5-1) 

which is not-quite-linear, because of the factor of y n on the right-hand side 
of equation 5.1 would be linear. It does reduce to a linear equation, when 
either n = 0 or n = 1. In the first case (n — 0), we have 

y'+p(t)y = q(t) (5.2) 

which is a general first-order equation. In the second case (n = l)the 
Bernoulli equation becomes 

y' + p(t)y = q(t)y (5.3) 

which can be rearranged to give 

y' = (q(t) - p(t))y (5.4) 

This can be solved by multiplying both sides of equation 5.4 by dt/y, and 
integrating: 

p(t))dt (5.5) 
p{t))dt + C (5.6) 

For any other value of n, Bernoulli equations can be made linear by making 
the substitution 
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Differentiating, 



Solving for dy/dt, 



y n (5.7) 



s-0 -»>»-"£ M 



■37 = i V -it, n^l (5.9) 

at 1 — n ai 

The restriction ton^l is not a problem because we have already shown 
how to solve the special case n = 1 in equation 5.6. 

Substituting equation 5.9 into 5.f gives 

1 dz 

y n ^+p(t)y = y n q(t) (5.10) 



1 — n dt 
Dividing through by y n , 

1 dz 



1 — ndt 

Substituting from equation 5.7 for z 

1 dz 



P(t)y"- n = q(t) (5.11) 



p(t)z = g(t) (5.12) 



1 — n dt 

Multiplying both sides of the equation by 1 — n, 

dz 

- + (l-n)p(t)z = (l-n)q(t) (5.13) 
which is a linear ODE for z in in standard form. 

Rather than writing a formula for the solution it is easier to remember the 
technique of (a) making a substitution z — y 1- ™; (b) rearranging to get 
a first-order linear equation in z; (c) solve the ODE for z; and then (d) 
substitute for y. 

Example 5.1. Solve the initial value problem 

y' + ty = t/y 3 (5.14) 
1/(0) = 2 (5.15) 
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This is a Bernoulli equation with n = -3, so we let 

z = y'- n = y 1 "^ = y 4 (5.16) 
The initial condition on z is 

z(0) = y{0) 4 = 2 1 A = 16 (5.17) 
Differentiating equation 5.16 

dz , ody . 

_ = 4w 3 -^ 5.18 

dt dt K ' 

Hence 



dy 1 dz 
dt ~ Ay^di 



(5.19) 



Substituting equation 5.19 into the original differential equation equation 
5.14 

1 dz t ,„ „ . 

Multiplying through by Ay 3 , 

dz 



, t , Uy 3 = 4i (5.21) 
Substituting for z from equation 5.16, 

dz 

— + Atz = At (5.22) 
dt 

This is a first order linear ODE in z with p(t) = At and q(t) — At. An 
integrating factor is 

fi = exp (^J 4tdtJ = e 2f2 (5.23) 
Multiplying equation 5.22 through by this /i gives 

dz < Atz) e 2t " = Ate*" (5.24) 



dt 

By construction the left hand side must be the exact derivative of z/i; hence 

± f^2t 2 \ _ A +„2t 
dt 



ze ZL = Ate zb (5.25) 
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Multiplying by dt and integrating, 



dt 



+2 



ze Ll )dt= 4ie zt dt (5.26) 



Hence 

ze 2t2 = e 2t2 + C (5.27) 
From the initial condition z(0) = 16, 

16e° = e° + C 16 = 1 + C =^> C = 15 (5.28) 

Thus 

z = l + 15e~ 2t2 (5.29) 
From equation 5.16, y = z 1 / 4 , hence 

y= [1 + I5e~ 2t I □ (5.30) 



Lesson 6 



Exponential Relaxation 



One of the most commonly used differential equations used for mathemat- 
ical modeling has the form 



d J = (6.1) 

dt T K ' 



where C and r are constants. This equation is so common that virtually 
all of the models in section 2.5 of the text, Modeling with Linear Equations, 
take this form, although they are not the only possible linear models. 

In the mathematical sciences all variables and constants have some units 
assigned to them, and in this case the units of C are the same as the units 
of y, and the units of r are time (or t). Equation 6.1 is both linear and 
separable, and we can solve it using either technique. For example, we can 
separate variables 



dy dt 



y-C t 



Integrating from (to, yo) to (t, y) (and changing the variables of integration 
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appropriately first, so that neither t nor y appear in cither integrand) 1 



du 

u-C 

\n\y-C\-\n\y 0 -C\ 

y-c 



In 



yo-c 

Exponentiating both sides of the equation 

y-c 



ds 



to ' 

t__h 

T T 

-(t-to) 



yo-C 



{t-t 0 )/T 



hence 



\y-C\ = \y 0 -C\e^/ T 



(6.3) 
(6.4) 
(6.5) 

(6.6) 
(6.7) 



The absolute value poses a bit of a problem of interpretation. However, the 
only way that the fraction 

F =£b < 88 > 

can change signs is if it passes through zero. This can only happen if 

0 = e^-M/T ( 69 ) 

which has no solution. So whatever the sign of F, it does not change. At 
t = t 0 we have 

y - C = y 0 - C (6.10) 



hence 



and 



y-c 



yo-c 
y-c 



= l 



yo-C 

so by continuity with the initial condition 



(6.11) 
(6.12) 



y = C+(y 0 -C)e^/ T (6.13) 
It is convenient to consider the two cases r > 0 and r < 0 separately. 



1 We must do this because we are using both t and y as endpoints of our integration, 
and hence must change the name of the symbols we use in the equation, e.g, first we 
turn (6.2) into du/(u — C) = ds/r. 
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Exponential Runaway 

First we consider r > 0. For convenience we will choose to = 0. Then 

y = C + (yo - Cy/ T (6.14) 

The solution will either increase exponentially to oo or decrease to — oo 
depending on the sign of yo — C. 

Example 6.1. Compound interest. If you deposit an amount yo in the 
bank and it accrues interest at a rate r, where r is measured in fraction per 
year (i.e., r — 0.03 means 3% per annum, and it has units of 1/year), and t 
is measured in years, then the rate at which the current amount on deposit 
increases is given by 

d j t =ry (6.15) 

Then we have C — 0 and r = 1/r, so 

y = Voe rt (6.16) 

So the value increases without bound over time (we don't have a case where 
yo < because that would mean you owe money). 

Suppose we also have a fixed salary S per year, and deposit that entirely 
into our account. Then instead of (6.15), we have 

^=ry + S = r(y + S/r) (6.17) 
at 

In this case we see that C = —S/r, the negative ratio of the fixed and 
interest-based additions to the account. The solution is then 

y = --+(yo + -)e rt (6.18) 
r \ r J 

We still increase exponentially without bounds. 

Now consider what happens if instead of depositing a salary we instead 
withdraw money at a fixed rate of W per year. Since W causes the total 
amount to decrease, the differential equation becomes 

^ = ry - W = r(y - W/r) (6.19) 

Now C = W/r. If W/r < yo then the rate of change will be positive initially 
and hence positive for all time, and we have 
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Figure 6.1: Illustration of compound interest at different rates of withdrawal 
in example 6.1. See text for details. 




If instead W/r > yo, the initial rate of change is negative so the amount will 
always be less than y$ and your net deposit is decreasing. The term on the 
right is exponentially increasing, but we can only make withdrawals into 
the balance is zero. This occurs when the right hand side of the equation 
is zero. 

v = (v- yo ) e (6 - 21) 

or at a time given by 

1 , A. _ Vo r \ 



So if you withdraw money at a rate faster than ryo you money will rapidly 
go away, while if you withdraw at a slower rate, your balance will still 
increase. Figure 6.1 shows the net balance assuming a starting deposit of 
$1000 and a hxed interest rate of 5% per annum, for rates of withdraw 
(bottom to top) of $250, $100, $60, and $40 per year. For the example the 
break-even point occurs when W = ry n = (.05)(1000)=$50. □ 



Exponential Relaxation 

When r < 0 we will see that the behavior is quite different - rather then 
exponential run-away, the solution is pulled to the value of C, whatever the 
initial value. We will call this phenomenon exponential relaxation. 

As before, it is convenient to assume that to — 0 and we also define T = 
—t > 0 as a positive time constant. Then we have 



y = C+(yo- C)e- l l T 



(6.23) 
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If yo — C 7^ 0 then the second term will be nonzero. The exponential 
factor is always decreasing, so the second term decreases in magnitude with 
time. Consequently the value of y — > C as t — > oo. To emphasize this we 
may chose to replace the symbol C with (this is common in biological 
modeling) giving 

y = Voo + (yo - 2/oo)e~ t/T (6.24) 

Example 6.2. RC-Circuits. An example from engineering is given by 
RC-circuits (see figure 6.3). The RC refers to a circuit that contains a 
battery (or other power source); a resistor of resistance R and a capacitor 
of capacity C. If there is an initial charge q on the capacity, then the charge 
will decay exponentially if the voltage is sent to zero. RC circuits have the 
following rules Electric Circuits are governed by the following rules: 

1. The voltage drop across a resistor (the difference in voltages between 
the two ends of the resistor) of resistance R with a current i flowing 
through it is given by AV res i Stor — iR (Ohm's Law) 

2. Current i represents a flow of charge i = dq/dt. 

3. If there is a voltage drop across a capacitor of capacitance C, there 
will be a charge q = CV on the capacitor, hence (by differentiating), 
there is a current of i = CdV/dt. 

4. The voltage drop across an inductor of inductance L is AVmductor — 
Ldi/dt. 

5. The total voltage drop around a loop must sum to zero. 
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Figure 6.3: Schematic of RC circuit used in example 6.2. 



c 



a 



V 



+ 



R 



6. The total current through any node (a point where multiple wires 
come together) must sum to zero (KirchofFs Law). 

If we were to measure the voltage between points a and b in an RC circuit 
as illustrated in fig 6.3, these rules tell us first that the capacitor should 
cause the voltage along the left branch to fluctuate according to 

= (6.25) 
at 

where iq is the current through the capacitor. If ir is the current through 
the resistor, then the voltage drop through the lower side of the circuit is 

V ab = V batt + i R R (6.26) 
Solving for the current through the resistor, 

Vab ^batt / n n w\ 

ir = ^ (6-27) 

Since the total current around the loop must be zero, ic + ir = 0, 

0 = ir + %c = 5 1- C— rr 6.28 

R dt 

Dropping the ab subscript, 
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This is identical to 

d J = Ys^X. (6.30) 

dt T K ' 

with 

Voo = V batt (6.31) 

t = RC (6.32) 

Therefore the voltage is given by 

V = V batt + (Vo - V batt )e-^ RC (6.33) 

where Vb is the voltage at t = 0. Regardless of the initial voltage, the 
voltage always tends towards the battery voltage. The current through the 
circuit is 

i = C— = V °- V ^ e -t/RC (6 34) 

dt R K ' 

so the current decays exponentially. □ 

Example 6.3. Newton's Law of Heating (or Cooling) says that the rate 
of change of the temperature T of an object (e.g., a potato) is proportional 
to the difference in temperatures between the object and its environment 
(e.g., an oven), i.e., 



— = k(T oven - T) (6.35) 

Suppose that the oven is set to 350 F and a potato at room temperature 
(70 F) is put in the oven at t = 0, with a baking thermometer inserted into 
the potato. After three minutes you observe that the temperature of the 
potato is 150. How long will it take the potato to reach a temperature of 
350? 

The initial value problem we have to solve is 



Dividing and integrating, 



From the initial condition 



T' = fc(400 - T) 1 
T(0) = 70 J 

J 400 -T J 
ln(400 — T) = kt + C 



(6.36) 

(6.37) 
(6.38) 



C = -ln(400- 70) = -In 330 (6.39) 
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Hence 

- ln(400 - T) = kt - In 330 (6.40) 
400 - T 

b ^mT = - kt < 6 - 41 > 

From the second observation, that T(3) = 150, 

1 33 

fc=gln^«.09 (6.43) 
400-T_ , 9t 



we conclude that 



From (6.41) 



(6.44) 

330 v ' 

T = 400 — 330e~ 09 * (6.45) 

The problem asked when the potato will reach a temperature of 350. Re- 
turning to (6.41) again, 

1 400 - 350 33 „„ , 

(« In ss 11 In— ss 20 minutes □ (6.46) 

.09 330 5 



The motion of an object subjected to external forces Fi,F 2 , ...is given by 
the solution of the differential equation 

Example 6.4. Falling Objects. Suppose an object of constant mass m 
is dropped from a height h, and is subject to two forces: gravity, and air 
resistance. The force of gravity can be expressed as 



Fgravity = -mg (6.47) 
where g = 9.8 meter s / sec ond 2 , and the force due to air resistance is 



F drag = -C D ^ (6.48) 



dy 
dt 

where Co is a known constant, the coefficient of drag; a typical value of 
Co ~ 2.2. According Newtonian mechanics 

i 

Making the substitution 
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this becomes a first-order ODE in v 

m-^ = —mg — Cpv (6.51) 

Example 6.5. Suppose we drop a 2010 penny off the top of the empire 
state building. How long will it take to hit the ground? 

The drag coefficient of a penny is approximately Cd ~ 1 and its mass is 
approximately 2.5 grams or 0.0025 kilograms. The height of the observation 
deck is 1250 feet = 381 meters. 

Since the initial velocity is zero, the IVP is 

v' = -9.8- v) 
v{0) =0 J 

Rearranging, 



v' + v = -9. 

An integrating factor is e* so 

d 



yve*) = -9.8e* 
dt v ; 



Integrating 

ve l = -9.8e f + C 

Dividing by e*, 

v « -9.8 + Ce- t 

From the initial condition, 

0 = -9.8 + C C = 9.8 

hence 

v = -9.8 + 9.8e"* 

Now we go back to our substitution of (6.50), we have another first 
linear differential equation: 

^ = -9.8 + 9.8e-* 
dt 

Integrating (6.59) 

y = -9.8t-9.8e-* + C 
If the object is dropped from a height of 381 meters then 

2/(0) - 381 



6.52) 
6.53) 

6.54) 

6.55) 
6.56) 

6.57) 

6.58) 
order 

6.59) 

6.60) 

6.61) 
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hence 

381 = -9.8 + C =>■ C«391 (6.62) 

thus 

y = -9.8£-9.8e-* + 391 (6.63) 
The object will hit the ground when y — 0, or 

0 = -9.8t-9.8e-*+998 (6.64) 

This can be solved numerically to give t sa 40 seconds. 2 . □ 



2 For example, in Mathematica, we can write NSolve [0 ==-9.8 t - 9.8 E~-t + 391, 

t] 



Lesson 7 



Autonomous Differential 
Equations and Population 
Models 



In an autonomous differential equation the right hand side does not de- 
pend explicitly on t, i.e., 

!-*»> <»> 

Consequently all autonomous differentiable equations are separable. All of 
the exponential models discussed in the previous section (e.g., falling ob- 
jects, cooling, RC-circuits, compound interest) are examples of autonomous 
differential equations. Many of the basic single-species population models 
are also autonomous. 



Exponential Growth 

The exponential growth model was first proposed by Thomas Malthus in 
1798. 1 The basic principle is that as members of a population come to- 
gether, they procreate, to produce more of the species. The rate at which 
people come together is assumed to be proportional to the the population, 
and it is assumed that procreation occurs at a fixed rate b. If y is the 
population, then more babies will be added to the population at a rate by. 



In the book An Essay on the Principle of Population. 
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Hence 

If we assume that people also die at a rate then 

^ = by- dy = (b- d)y = ry (7.3) 
where r = b — d. As we have seen, the solution of this equation is 

V = Voe rt (7.4) 

Hence if the birth rate exceeds the death rate, then r — b — d > 0 and the 
population will increase without bounds. If the death rate exceeds the birth 
rate then the population will eventually die if. Only if they are precisely 
balanced will the population remain fixed. 

Logistic Growth 

Exponential population growth is certainly seen when resources (e.g., food 
and water) are readily available and there is no competition; an example 
is bacterial growth. However, eventually the population will become very 
large and multiple members of the same population will be competing for 
the same resources. The members who cannot get the resources will die off. 
The rate at which members die is thus proportional to the population: 

d = ay (7.5) 

so that 

~=ry-dy = by- ay 2 = ry (l - ~y^J (7.6) 
for some constant a. It is customary to define 

K=- (7.7) 

a 

which is called the carrying capacity of the population: 

t -it-® w> 

Equation (7.8) is called the logistic growth model, or logistic differential 
equation. We can analyze this differential equation (without solving it) 
by looking at the right hand side, which tells us how fast the population 
increases (or decreases) as a function of population. This is illustrated in 
figure 7.1 



55 



Figure 7.1: A plot of the right-hand side of y' = f(y) for the logistic model 
in equation 7.8. When f(y) > 0, we know that dy/dt > 0 and thus y will 
increase, illustrated by a rightward pointing arrow. Similarly, y decreases 
when f(y) < 0. All arrows point toward the steady state at y = K . 



When y < K, then dy/dx > 0, so the population will increase; this is 
represented by the arrow pointing to the right. When y > K, dy/dt < 0, 
so the population will decrease. So no matter what the starting value of 
y (except for y = 0), the arrows always point towards y = K. This tells 
us that the population will approach y = K as time progresses. Thus the 
carrying capacity tells us the long-term (or steady state) population. 

We can solve the logistic model explicitly. In general this is not something 
we can do in mathematical modeling, hence the frequent use of simple 
models like exponential or logistic growth. Rewrite (7.8) and separating 
the variables: 



dy/dt 



rK/4 




y 




(7.9) 



Using partial fractions, 



1 



.4 



B 



(7.10) 



y{K - y) 



+ 



K-y 



II 



Cross multiplying and equating the numerators, 



l = A(K-y) + By 



(7.11) 



Substituting y = K gives B = 1/K; and substituting y = 0 gives A = 1/K. 
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Hence 



/dy 1 f dy 1 t dy 

y(K-y) = kJJ + kJ K-y 



~ (Iny - ln(K - y)) 



Using (7.14) in (7.9) 



K K-y 



In — — =rt + C 



K-y 

Multiplying through by K and exponentiating, 

V = e rt+c = e rt e c 
K-y 

If we set 2/(0) = yo then 



K-y 0 

Hence 



V = Vo c rt 
K-y K - y 0 



Multiplying by K — y, 



y = K ~F? e +y— e 

K-Vo K -yo 

Bringing the second term to the left and factoring a y, 

Vo „rA _ Vo rt 



y 1 + ™ e rt = K ™ 

y \ K-y 0 J K-y 0 
Multiplying both sides by K — yo , 

y(K-y Q + y 0 e rt ) = Ky 0 e rt 

Solving for y, 

Ky 0 e rt 
V {K - yo) + y 0 e rt 
= Kyp 

yo + {K - y 0 )e- rt 

We can see from equation (7.23) that for large t the second term in the 
denominator approaches zero, hence y — !• K. 
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Figure 7.2: Solutions of the logistic growth model, equation (7.23). All 
nonzero initial populations tend towards the carrying capacity K as t — > oo. 




Thresholding Model 

If we switch the sign of equation (7.8) it becomes 



dt 



.'/(l |) (7.24) 



where we still assume that r > 0 and T > 0. The analysis is illustrated 
below. Instead of all populations approaching T, as it did in the logistic 
model, all models diverge from T. 

The number T is a threshold of the model. At the value y = T the behavior 
of the solution changes. We expect unlimited growth if y 0 > T and that y 
will decay towards zero if yo < T. This type of model describes a species in 
which there is not sufficient procreation to overcome the death rate unless 
the initial population is large enough. Otherwise the different members 
don't run into each other often enough to make new babies. Following the 
same methods as previously we obtain the solution 

V = — —77^ v~r t (7-25) 

We point out the difference between (7.25) and (7.23) - which is the sign of 
r in the exponential in the denominator. 

When yo < T then equation (7.25) predicts that y — > 0 as t — > oo. It 
would appear to tell us the same thing for T < yo but this is misleading. 
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Figure 7.3: Plot of the right hand side of the thresholding model (7.24). 
Since f(y) < 0 when y < T, the population decreases; when y > T, the 
population increases. 



dy/dt 




Suppose that yo is just a little bit larger than T. Then the population 
because increasing because the right hand side of the equation is positive. 
As time progresses the second term in the denominator, which is negative, 
gets larger and larger. This means that the denominator is getting smaller. 
This causes the population to grow even faster. The denominator becomes 
zero at t = t* given by 

0 = 2A) + (T-2/ 0 )e rt * (7.26) 



Solving for t* 



t* = - In (7.27) 
r yo-T 



Since y > T the argument of the logarithm is positive, so the solution gives 
a positive real value for t* . At this point, the population is predicted to 
reach oo; in other words, t = t* is a vertical asymptote of the solution. 



Logistic Growth with a Threshold 

The problem with the threshold model is that it blows up. More realis- 
tically, when yo > T, we would expect the rate of growth to eventually 
decrease as the population gets larger, perhaps eventually reaching some 
carrying capacity. In other words, we want the population to behave like a 
thresholding model for low populations, and like a logistic model for larger 
populations. 
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Figure 7.4: Solutions of the threshold model given by (7.25). When yo < T 
the population slow decays to zero; when yo > T the population increases 
without bounds, increasing asymptotically to oo at a time t* that depends 
on y 0 and T (eq. (7.27)). 



y 



T 




Suppose we have a logistic model, but let the rate of increase depend on 
the population: 

dy 
dt 

We want the rate of increase to have a threshold 



= r(j/)j/(l-|) (7.28) 



combining these two 



'■UP = -/■(!- |) (7.29) 



S = --M)0-f) <™> 



Now we have a growth rate with three zeros at y = 0, y = T, and = K, 
where we want 0 < T < K. If the population exceeds T then it approaches 
K , while if it is less than T it diminishes to zero. 
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Figure 7.5: Top: The rate of population change for the logistic model with 
threshold given by equation (7.30). For t 0 > T all populations tend towards 
the carrying capacity K; all smaller initial populations decay away towards 
zero. Bottom: The solutions for different initial conditions. 

dy/dt 




Lesson 8 



Homogeneous Equations 



Definition 8.1. An ordinary differential equation is said to be homoge- 
neous if it can be written in the form 



Another way of stating this definition is say that 

y' = f(t,y) (8.2) 

is homogeneous if there exists some function g such that 

y< = g(z) (8.3) 

where z = y/t. 
Example 8.1. Show that 

dy 2ty 



dt t 2 - 3y 2 

is homogeneous. 
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(8.4) 
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The equation has the form y' = f(t, y) where 



2ty 



(fi)(l-3(y/tr) 

1 - 3(2//i) 2 
2z 



(8.6) 
(8.7) 
(8.8) 



l-3z 2 

where z = y/t. Hence the ODE is homogeneous. □ 

The following procedure shows that any homogeneous equation can be con- 
verted to a separable equation in z by substituting z = y/t. 

Let z = y/t. Then y = tz and thus 

dy d . . dz . 
-f = —(tz) = t— + z (8.9) 
dt dV 1 dt y J 



Thus if 



then 



dt 



(8-10) 

t^ + z = g(z) (8.11) 



where z = y/t. Bringing the the z to the right-hand side, 



t^=g(z)-z (8.12) 



dz g(z) — z 
dt ~ t 
dz dt 



(8.13) 
(8.14) 



g{z) — z t 
which is a separable equation in z. 

Example 8.2. Find the one-parameter family of solutions to 

«' = £££ (8.15) 

Since 
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where z — y/t, the differential equation is homogeneous. Hence by equation 
(8.12) it is equivalent to the following equation in z: 



dz , 
t— + z = z 2 + 2z 
at 



Rearranging and separating variables, 

dz 



dt 



z 2 + z 



dt dz 



dz 



1 1 



Integrating, 



t z 2 + z z(l + z) \z l + z 

dz 



(8.17) 

(8.18) 

(8.19) 

(8.20) 
(8.21) 

(8 " 22) 

for some new constant C. Dropping the prime on the C and rearranging 
to solve for z, 

(l + z)t = Cz 

t = Cz-zt = z(C- t) 
t 



dt 
T 



dz 

z 



l + z 



\n\t\ = ln\z\ - In II + z\ + C = In 



l + z 



C 



Exponentiating, 



t = 



C'z 



C-t 

Since we started the whole process by substituting z = y/t then 



.23) 
.24) 

.25) 



y = zt = 



t 2 



C-t 



as the general solution of the original differential equation. 
Example 8.3. Solve the initial value problem 

dy = y _ i 

dt t 
W(l) = 2 

Letting z = y/t the differential equation becomes 

dy 



dt 



z-l 



.26) 

□ 

.27) 
.28) 
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Substituting y' = (zt)' = tz' + z gives 

dz 

t— + z = z-l 
at 

Canceling the z's on both sides of the equation 

dz _ 1 
~dt ~ ~t 

dt 
T 

Integrating, 



I iz = -J 



z = -lnt + C* 
Since z = y/t then y = tz, hence 

y = t(C -\nt) 

From the initial condition y(l) = 2, 

2 = (l)(C-lnl) = C 

Hence 

y = t(2-]nt) □ 



Lesson 9 



Exact Equations 



We can re-write any differential equation 

f = /(*-y) (9- 1 ) 

into the form 

M(t,y)dt + N(t,y)dy = 0 (9.2) 
Usually there will be many different ways to do this. 

Example 9.1. Convert the differential equation y' = 3t + y into the form 
of equation 9.2. 

First we write the equation as 

f=3* + 9 (9.3) 

Multiply across by dt: 

dy = (3t + y)dt (9.4) 
Now bring all the terms to the left, 

- (3t + y)dt + dy = 0 (9.5) 

Here we have 

M(t,y) = -3t + y (9.6) 

N(t,y) = l (9.7) 
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This is not the only way we could have solved the problem. We could have 
stated by dividing by the right-hand side, 

dy = dt (9.8) 



3t + y 

To give 



-dt+-±—dy = 0 (9.9) 
3t + y 

which is also in the desired form, but with 

M(t,y) = -l (9.10) 

In general there are infinitely many ways to do this conversion. □ 

Now recall from calculus that the derivative of a function <p(t, y) with re- 
spect to a third variable, say u, is given by 

^ <f>(t ) d4> dt ^ dip dy ^\ 
du ' dt du dy du 

and that the exact differential of <j>(t,y) is obtained from (9.12) by multi- 
plication by du: 

d^(t,y) = ^dt+^dy (9.13) 
We can integrate the left hand side: 

d<j) = <j) + C (9.14) 

If, however, the right hand side is equal to zero, so that d<p = 0, then 

O=/d0 = 0 + C*=^0 = C" (9.15) 



where C — — C is still a constant. 
Let us summarize: 



dcj) = 0 => 4> = C (9.16) 



for some constant C . 

If d(f> = 0 then the right hand side of (9.12) is also zero, hence 

%* + %*y = Q^* = C (9.17) 
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Now compare equation (9.2) with (9.17). The earlier equation says that 

M(t,y)dt + N(t,y)dy = 0 (9.18) 
This means that if there is some function (f> such that 

M = 9 4 and N = ^ (9.19) 
at ay 

Then <fi = C is a solution of the differential equation. 

So how do we know when equation (9.19) holds? The answer comes from 
taking the cross derivatives: 

dM d 2 S d 2 6 ON 



dy dydt dtdy dt 



(9.20) 



The second equality follows because the order of partial differentiation can 
be reversed. 



Theorem 9.1. If 

dM dN 
dy dt 


(9.21) 


then the differential equation 




M(t,y)dt + N(t,y)dy = 0 


(9.22) 


is called an exact differential equation and the solution is 


given by some 


function 




4>(t,y) = C 


(9.23) 


where 

1# d<P , Ar dcf> 
M = — - and N = — - 
dt dy 




(9.24) 



We illustrate the method of solution with the following example. 
Example 9.2. Solve 

(2t + y 2 )dt + 2tydy = 0 (9.25) 
This is in the form Mdt + Ndy — 0 where 

M(t,y) = 2t + y 2 and N(t,y) = 2ty (9.26) 
First we check to make sure the equation is exact: 

^ + (9.27) 
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and 

dN d 

-m=8t^ = 2y (9 - 28) 

Since 

M y = N t (9.29) 
the equation is exact, and therefore the solution is 

c/> = C (9.30) 

where 

0t 



''" M = 2t + y 2 (9.31) 



and 

®^=N = 2ty (9.32) 

To solve the original ODE (9.25) we need to solve the two partial differential 
equations (9.31) and (9.32). Fortunately we can illustrate a procedure to 
do this that does not require any knowledge of the methods of partial 
differential equations, and this method will always work. 

Method 1 . Start with equation (9.31) 

^=2t + y 2 (9.33) 

Integrate both sides over t (because the derivative is with respect to t), 
treating y as a constant in the integration. If we do this, then the constant 
of integration may depend on y: 

J ^dt = J (2t + y 2 )dt (9.34) 
<j> = t 2 + y 2 t + g{y) (9.35) 

where g{y) is the constant of integration that depends on y. Now substitute 
(9.35) into (9.32) 

d 

— (t 2 +y 2 t + g(y)) = 2ty (9.36) 
Evaluating the partial derivatives, 

2yt + = 2t y (9.37) 

dy 

Since g(y) only depends on y, then the partial derivative is the same as 

g'(y)- 

2yt + ^ = 2ty (9.38) 
dy 
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Hence 

^ = 0 =^ g = C (9.39) 
ay 

for some constant C . Substituting (9.39) into (9.35) gives 

0 = t 2 + y 2 t + C (9.40) 
But since </> = C is a solution, we conclude that 

t 2 + y 2 t = C" (9.41) 
is a solution for some constant C" . 

Method 2 Start with equation (9.32) and integrate over y first, treating t 
as a constant, and treating the constant of integration as a function h{t) : 

~ = 2*1/ (9.42) 
dy 

^dy = J Itydy (9.43) 
cj) = ty 2 + h{t) (9.44) 
Differentiate with respect to t and use equation (9.31) 

g _«(^ + »(,))_/ + * =2t + 9 * (9.45) 

where the last equality follows from equation (9.31). Thus 

— - 2t =>• h = t 2 (9.46) 

We can ignore the constant of integration because we will pick it up at the 
end. From equation (9.44), 

(j) = ty 2 + h(t) = ty 2 + t 2 (9.47) 

Since 4> — C is the solution of (9.25), we obtain 

ty 2 +t 2 =C (9.48) 

is the solution. □ 



Now we can derive the method in general. Suppose that 
M(t,y)dt + N(t,y)dy = Q 



(9.49) 
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where 

M y (t,y) =N t (t,y) (9.50) 

Then we conclude that 

4>(t,y) = C (9.51) 

is a solution where 

tk(t, y) = M(t, y) and <j> y {t, y) = N(t, y) (9.52) 
We start with the first equation in (9.52), multiply by dt and integrate: 

<j> = [ <k(t,y)dt= { M(t,y)dt + g(y) (9.53) 



Differentiate with respect to y: 

^v^^yj M(t,y)dt + g'(y) = J M y (t,y)dt + g'(y) (9.54) 
Hence, using the second equation in (9.52) 



Ay) = <P v (t,y)- J M y (t,y)dt (9.55) 
= N(t,y)- [ M y (t,y)dt (9.56) 



Now multiply by dy and integrate: 

g(y) = J g'(y)dy = J (N(t, y)-J M„(t, y)dt^ dy (9.57) 

From equation (9.53) 

ct>(t,y) = J M(t,y)dt + J \N(t,y)- J M v (t,y)dtj dy (9.58) 

Alternatively, we can start with the second of equations (9.52), multiply by 
dy (because the derivative is with respect to y), and integrate: 

<b y (t : y)dy = J N(t,y)dy + h(t) (9.59) 

where the constant of integration depends, possibly, on t, because we only 
integrated over y. Differentiate with respect to t: 

4>t{t, y) = § t f N & y) d v + h '(t) = I N t& y)dy + ti(t) (9m) 
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From the first of equations (9.52), 

M(t,y) = f N t (t,y)dy + ti(t) (9.61) 



hence 

h'(t)=M(t,y)- I N t (t,y)dy (9.62) 



Multiply by dt and integrate, 

h(t) = J h'(t)dt = I [Mil.!,) - I XiU.iiul/))*!! .<).(«! 

From (9.59) 

4>(t,y) = J N{t,y)dy + J \ M(t t y) - J N t (t.!,)du j ,// (!).(i4) 
The following theorem summarizes the derivation. 



Theorem 9.2. If M(t, y)dt + N(t, y)dy = 0 is exact, i.e., if 

dM(t,y) = dN(t,y) 
dy dt 



(9.65) 



The 4>(t, y) — C is a solution of the ODE, where either of the following 
formulas can be used for </>: 

<j>(t,y) = J M{t,y)dt + J \N{t,y) - J M y (t,y)dtj dy (9.66) 

<Kt,y) = [ N(t,y)dy+ f \M(t,y)- f N t (t,y)dy] dt (9.67) 



In practice, however, it is generally easier to repeat the derivation rather 
than memorizing the formula. 

Example 9.3. Solve 

(t + 2y)dt + (2t - y)dy = 0 (9.68) 

This has the form M(t, y)dt + N(t, y)dy where 

M(t,y)=t + 2y (9.69) 

N(t,y) = 2t-y (9.70) 

Checking that it is exact, 

M y (t,y) = 2 = N t (t,y) (9.71) 
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Hence (9.68) is exact and the solution is given by <fi(t,y) — C where 

M(x,y)=t + 2y (9.72) 



dy 

Integrating (9.73) over t, 



at 

' U = N(t,y) = 2t-y (9.73) 



y)=l Qt dt = J (t + 2y)dt = -t z + 2ty + h(y) (9.74) 

because the constant of integration may be a function of y. Taking the 
partial with respect to y and setting the result equal to (9.73) 



7 f = 2t + h'(y)=2t-y (9.75) 
dy 

Thus 

h'(y) = -y =► My) = -y (9-76) 

we conclude that = — y or h(y) = —y 2 /2. From equation (9.74) 

^y)= 1 -t 2 + 2ty- 1 -y 2 (9.77) 

Therefore the solution is 

\t 2 + 2ty- l -y 2 = C (9.78) 

for any constant C . □ 
Example 9.4. Find the one-parameter family of solutions to 

y' = - y cost + 2teV (9 . 79) 
sint + t 2 e^ + 2 v ' 

We can rewrite the equation (9.79) as 

(ycost + 2te y )dt + (sint + t 2 e y + 2)dy = 0 (9.80) 

which has the form M(t, y)dt + N(t, y)dy — 0 where 

M (t, y) = y cos t + 2te y (9.81) 
N{t,y) =sint + t 2 e y + 2 (9.82) 
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Differentiating equations (9.81) and (9.82) gives 

d ^l = co S t + 2tey= 9 J^l (9.83) 
oy ot 

and consequently equation (9.79) is exact. Hence the solution is 

4>(t,y) = C (9.84) 

where 

^ = M(t,y) = ycost + 2te y (9.85) 
at 

=N(t,y) =sint + t 2 e y + 2 (9.86) 

oy 

Integrating equation (9.85) over t 

<f,(t, V) = J ~ dt = J (ycost + 2te v )dt = ysmt + t 2 e y + h(y) (9.87) 

where h is an unknown function of y. 

Differentiating (9.87) respect to y and setting the result equal to (9.86) 
gives 

^ = sinf + t 2 e y + h'(y) = smt + t 2 e y + 2 (9.88) 
oy 

Thus 

h'(y) = 2 =^ h(y) = 2y (9.89) 

Using this back in equation (9.87) 

<j){t,y) = ysmt + t 2 e y + 2y (9.90) 

Hence the required family of solutiosn is 

ysint + t 2 e y + 2y = C (9.91) 

for any value of the constant C. □ 

Example 9.5. Solve the differential equation 

, at — by . „. 

V = -, 9-92) 

bt + cy v ' 

where a, b, c, and d are arbitrary constants. 
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Rearranging the ODE, 

(by - at)dt + (bt + cy)dy = 0 (9.93) 

which is of the form M(t, y)dt + N(t, y)dy — 0 with 

M(t,y) = by-at (9.94) 

N(t,y) = bt + cy (9.95) 

Since 

M y = b= N t (9.96) 
equation (9.93) is exact. Therefore the solution is <j>(t,y) = K, where 
d<t>(t,y) 



dt 
d<j>(t,y) 
dy 



= M{t,y) = by - at (9.97) 
= N(t,y) = bt + cy (9.98) 



and K is any arbitrary constant (we don't use C because it is confusing 
with c already in the problem). Integrating equation in (9.97) over t gives 

<f>(t, y) = J (by - at)dt = byt - V + h(y) (9.99) 

Differentiating with respect to y and setting the result equal to the (9.98), 

bt + h'(y)=bt + cy (9.100) 



h'(y) =cy =*. h(y) = °-y 2 (9.101) 



From equation (9.99) 



y)= J (by - at)dt = byt - ^t 2 + C -y 2 (9.102) 

Therefore the solution of (9.92) is 

J (by - at)dt = byt - ^t 2 + ^y 2 = K (9.103) 

for any value of the constant K. □ 
Example 9.6. Solve the initial value problem 

(2ye 2t + 2t cos y)dt + (e 2t - t 2 siny)dy = o\ 



v(o) 



(9.104) 
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This has the form Mdt + Ndy = 0 with 

M(t,y) = 2ye 2t + 2icosy (9.105) 

N(t,y) = e 2t -fsiny (9.106) 

Since 

M v = 2e 2t - 2sin?/ = N t (9.107) 

we conclude that (9.104) is exact. Therefor the solution of the differential 
is equation <p(t, y) — C for some constant C, where 

U = M(t,y) = 2ye 2t + 2tcosy (9.108) 
at 

^ =JV(t,y) =e 2t -t 2 siny (9.109) 
dy 

Integrating (9.108) over t 



<f>(t,y) = J (2ye M + 2t cos y)dt + h{y) =ye M + t A cosy + h(y) (9.110) 
Taking the partial derivative with respect to y gives 

^=e 2t -t 2 smy + h'(y) (9.111) 

Comparison of equations (9.111) and (9.109) gives h'(y) — 0; hence h(y) is 
constant. Therefore 

4>{t,y) = ye 2t + t 2 cosy (9.112) 
and the general solution is 

ye 2t + t 2 cos y = C (9.113) 
From the initial condition y(fi) = 1, 

(l)(e°) + (0 2 ) cos 1 = C =^ C = 1 (9.114) 

and therefore the solution of the initial value problem is 

ye 2t +t 2 cosy = 1. □ (9.115) 
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(9.116) 



Example 9.7. Solve the initial value problem 

(y/t + cost)dt + (e y + \nt)dy = ol 
y(7r) = 0 J 

The ODE has the form Mdt + Ndy = 0 with 

M(t,y) = y/t + cost (9.117) 

N(t,y) = e y + \nt (9.118) 

Checking the partial derivatives, 

M v = \ = N t ( 9 - 119 ) 

hence the differential equation is exact. Thus the solution is (f>(t,y) = C 
where 

^ =M(t,y) = ^+cosi (9.120) 

^ = N(t,y) = e y +lnt (9.121) 
Integrating the first of these equations 

c()(t,y) = J (~+cost)dt + h(y)=ylnt + sint + h(y) (9.122) 
Differentiating with respect to y and setting the result equal to (9.121), 

^ = ^-(y\nt + ant + h(y)) = N(t,y) = e y + lnt (9.123) 
ay ay 

lnt + h'(y) = e y +\nt (9.124) 

h'{y) = e y =>> h(y) = e y (9.125) 

From (9.122), 

=) = ylni + sini + e y (9.126) 
The general solution of the differential equation is 4>(t, y) = C, i.e., 

y\nt + smt + e y = C (9.127) 
The initial condition is y(n) = 0; hence 

(0)ln7r + sin7r + e° = C =^> C = 1 (9.128) 

Thus 

ylnt + smt + e y = 1. □ (9.129) 



Lesson 10 

Integrating Factors 



Definition 10.1. An integrating factor for the differential equation 

M(t,y)dt + N(t,y)dy = 0 (10.1) 
is a any function such fi(t,y) such that 

[i(t, y)M (f , y)dt + n(t, y)N(t, y)dy = 0 (10.2) 

is exact. 

If (10.2) is exact, then by theorem 9.1 

— (f,(t,y)M(t,y)) = -(»(t,y)N(t,y)) (10.3) 

In this section we will discuss some special cases in which we can solve (10.3) 
to find an integrating factor fJ.{t,y) that satisfies (10.3). First we give an 
example to that demonstrates how we can use an integrating factor. 

Example 10.1. Show that 

sinw „ f . \ , /cos y + 2e~* cost \ , n . 

2e"*sint )dt+[ ) dy = 0 (10.4) 



y / v y 

is not exact, and then show that 

V(t,y)=ye t (10.5) 

is an integrating factor for (10.4), and then use the integrating factor to 
find a general solution of (10.4). 
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We are first asked to verify that (10.4) is not exact. To do this we must 
show that My ^ N x , so we calculate the partial derivatives. 

DM d f sin y _ t . ^ y cost — siny 



2e"* sini = = = - (10.6) 



dy dy \ y J y 

dN d /cosj/ + 2e-*cost\ 2 



dt dt \ y 



= — e~* (sin* + cost) (10.7) 



Since M y ^ iV t we may conclude that equation (10.4) is not exact. 

To show that (10.5) is an integrating factor, we multiply the differential 
equation by /i(t, y). This gives 

(e* siny - 2y sint) dt + (e* cosy + 2 cost) dy = 0 (10.8) 

which is in the form M(t, y)dt + N(t, y)dy with 

M(t,y) = e* siny- 2y sin* (10.9) 
7V(t,y) = e* cosy + 2 cost (10.10) 

The partial derivatives are 

dM(t,y) d , t . . . n 1X 

a ^ = e* siny -2y sin* 10.11 
dy dy 

= e*(cosy- 2sint) (10.12) 
diV(*,y) = 9 t 

dt dt K ' x ' 

= e*(cosy- 2sint) (10.14) 

Since M y — N t , we may conclude that (10.8) is exact. 

Since (10.8) is exact, its solution is (j)(t,y) — C for some function <j> that 
satisifes 



^ = M(t, y) = e* sin y-2y sin* (10.15) 

^ = N(t,y) = e*cosy + 2cos* (10.16) 
dy 



From (10.15) 
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«(/.,/) I^M-dt + h(y) (10.17) 

M(t,y)dt + h(y) (10.18) 

(e*sin2/-2ysin*)di + /i(y) (10.19) 

= e t siny + 2ycost + %) (10.20) 

Differentiating with respect to y, 

dW, y) ^ e t CQSy + 2 CQS t + ft ; / x (1Q 21) 
dy 

From equation (10.16), 

e* cosy + 2 cost + ft'(y) = e* cos y + 2 cos t (10.22) 

= 0 =S> /i(y) = constant (10.23) 

Recall the that solution is </>(t, y) = C where from (10.20), and using /i(y) = 
K, 

cf)(t,y) = e t smy + 2cost + K (10.24) 

hence 

e* sin y + 2y cost = C (10.25) 
is the general solution of (10.8). □ 

There is no general method for solving (10.3) to find an integrating fac- 
tor; however, sometimes we can find an integrating factor that works under 
certain simplifying assumptions. Wc will present five of these possible sim- 
plifications here as theorems. Only the first case is actually discussed in 
Boyce & DiPrima (6th Edition). 

Theorem 10.2. Integrating Factors, Case 1. If 

^"^^^'(t) (10-26) 
is only a function of t, but does not depend on y, then 

^(t,y) = exp (/ P«(t)dt) = exp (J ^yMz^M^ ( 10 .27) 
is an integrating factor. 
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Theorem 10.3. Integrating Factors, Case 2. If 

P^\t,y) = Nt{t % M /' v) ^P^{y) (10.28) 

is only a function of y, but does not depend on t, then 

, (2 Ht,y) = cxp (/ pWfo)*) = exp (/ m % M y f V) ^ (10.29) 
is an integrating factor. 

Theorem 10.4. Integrating Factors, Case 3. If 

(8) = N t (t y) — My (t y) (3) 

V ' tf; tM(t,y) - yN(t,y) K> K ' 

is only a function of the product z = ty, but does not depend on either t 
or y in any other way, then 

^»)-^(/^)-^(/ ^:^ 

(10.31) 

is an integrating factor. 

Theorem 10.5. Integrating Factors, Case 4. If 

p(4)( } = *mt,y)-M{t,y)) (4) 

^ tM{t,y)+yN{t,y) w 1 ; 

is only a function of the quotient z = y/t, but does not depend on either i 
or y in any other way, then 

(10.33) 

is an integrating factor. 

Theorem 10.6. Integrating Factors, Case 5. If 

p( .) (tj } = V>{M {t,y)-N t {t,y)) (5) 

V ' y; tM(t,y)+yN(t,y) y > 1 ; 

is only a function of the quotient z = t/y, but does not depend on either t 
or y in any other way, then 

(10.35) 

is an integrating factor. 
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Proof. In each of the five cases we are trying to show that /i(t, y) is an 
integrating factor of the differential equation 

M(t,y)dt + N(t,y)dy = 0 (10.36) 

We have already shown in the discussion leading to equation (10.3) that 
fi(t,y) will be an integrating factor of (10.36) if n(t,y) satisfies 

— (ji(t, y)M(t, y)) = - (fi(t, y)N(t, y)) (10.37) 

By the product rule for derivatives, 

li(t, y)M y (t, y) + ny{t, y)M (t, y) = M (t, y)N t (t, y) + fi t {t, y)N(t, y) (10.38) 

To prove each theorem, we need to show that under the given assumptions 
for that theorem, the formula for n(t,y) satisfies equation (10.38). 

Case 1 . If fJ,(t,y) is only a functions of t then (a) ijLy(t,y) = 0 (there is 
no y in the equation, hence the corresponding partial is zero); and (b) 
/it(t,y) = £t'(i) (fj, only depends on a single variable, t, so there is no 
distinction between the partial and regular derivative). Hence equation 
(10.37) becomes 

n(t)M y (t, y) = fx(t)N t (t, y) + fi'(t)N(t, y) (10.39) 

Rearranging, 

d , , MJt.y) - NAt.y) , . . , 

Separating variables, and integrating, 

1 f M y (t,y)-N t (t,y) 



Hence 



m^ im =l w.v) dt (10 ' 41) 



ln/x(t) = j pM(t)dt => n(t) =cxp pW(t)dt\ (10.42) 

as required by equation (10.27). D(Case 1) 

Case 2. If [i(t, y) = [i{y) is only a function of y then (a) fi t (t, y) = 0 (because 
H has no i-dependence); and (b) n v (t,y) = n'{t) (because /i is only a 
function of a single variable y). Hence (10.38) becomes 

(x(y)M y (t,y) + ti'(y)M(t,y) = »(y)N t {t,y) (10.43) 
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Rearranging, 



i \ {y)= mA^m =P m iy) (10 .44) 



Ky)dy™' M(t,y) 
Multiply by dy and integrating, 

Sw)Ty^ )dy = S Pi ^ )dy (10 ' 45) 
Integrating and exponentiating 

M (y) = exp^y P {2 \y)dy^j 



(10.46) 



as required by equation (10.29). D(Case 2). 

Case 3 . If fj,(t, y) — (m(z) is only a function of z — ty then 

? = ^ = y (10-47) 

dt dt y K ' 

dz d(ty) 

dy = ^ = t (1 °- 48) 
Since n(z) is only a function of a single variable z we will denote 

A*) = % (10-49) 

By the chain rule and equations (10. 47), (10.48), and (10.49), 

dfi dfidz 

m = Tzdi = » {z)v (10 - 50) 

d[i dudz nnKi\ 

dy- = Tzdy=» {z)t (1 °- 51) 

Using these results in (10.38), 

fi(z)M v {t, y) + n'(z)M(t, y) = n(z)N t (t, y) + n'{z)yN{t i y) (10.52) 

//(*) x (tM(t,y)-yN(t,y))=n(z) x (N t (t, y) - M y (t, y)) (10.53) 

/*(«) tM(t,y)-yN(t,y)) [ > K ' 



Integrating and exponentiating, 

M 2 ) = exp(/P<s>(^) 



(10.55) 
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as required by equation (10.31). n(Case 3) 

Case 4 . If /j,(t, y) — n{z) is only a function of z = y/t then 



dz d y y 
dt = dtt = ~j? 
dz d y 1 
dy dy t t 



(10.56) 
(10.57) 



By thee chain rule 



d/j, d^idz ,y Mnna\ 

dt = dzdt = - tl T> (10 ' 58) 

dj-i dfi dz fj,' 
dy dz dy t 



(10.59) 



where fi'(z) = du/dz. Equation (10.38) becomes 

fi(z)M y (t,y) + x M(t,y) = fx(y)N t (t,y) + x N(t,y) 

(10.60) 

Rearranging and solving for fi'(z) 

fi(z)(M y (t,y) - N t (t,y)) = -//(*) + (10.61) 

= -^P-(yN(t,y) + tM(t,y)) (10.62) 

gV) = t 2 {N t {t,y)~M y (t,y) 
n(z) yN(t,y)+tM(t,y) 

Integrating and exponentiating, 



_ p(4) 



P (4, (z) (10.63) 



(10.64) 



as required by equation (10.33). n(Case 4) 

Case 5. If /j,(t, y) — ji(z) is only a function of z — t/y then 



84 



LESSON 10. INTEGRATING FACTORS 



By the chain rule, 

~=~S=~ (10-67) 
dt dz dt y x ' 

dji = d^ch = _^!t L (10 68) 

dy dz dy y 2 

where (i'(z) — du/dz. Substituting this into equation (10.38) gives 
fi(z)M y (t, y) + ( Z^)l\ M (t : y) = »(z)N t (t, y) + ( ^ ) N(t, y) 



(10.69) 



Rearranging 



^z)(M y (t,y)~NAt,y))=^^^N(t,y)+^^^M(t,y) (10.70) 

= ^(yN(t,y)+tM(t,y)) (10.71) 

y 

//(z) _ y 2 (M y (t,y) ~ N t (t,y)) _ (5) 

M (z) " yN(t,y)+tM(t,y) ~* [Z) { ^ U} 

Multiplying by dz, integrating, and exponentiating gives 

jj,(z) = cxp (J P^(z)dz) (10.73) 

as required by equation (10.35). n(Case 5) 

This completes the proof for all five case. □ 

Example 10.2. . Solve the differential equation 

(3ty + y 2 ) + (t 2 + ty)y' = 0 (10.74) 

by finding an integrating factor that makes it exact. 
This equation has the form Mdt + Ndy where 

M(t,y) = 3ty + y 2 (10.75) 

N(t,y) =t 2 +ty (10.76) 

First, check to see if the equation is already exact. 

M y = 3t + 2y (10.77) 

N t = 2t + y (10.78) 
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Since M y ^ N t , equation (10.74) is not exact. 

We proceed to check cases 1 through 5 to see if we can find an integrating 
factor. 

pV(t,y) = Mv^± (10 .79) 

= (v + 2y)-(* + y) (10 . 80) 

t 2 + ty y ' 

= = 1 (10.81) 

t 2 +ty t x ' 

This depends only on t, hence we can use case (1). The integrating factor 
is 



fx(t) = exp P(t)dt^ = exp (^J ~^dt^j = exp (In 



t) = t (10.82) 



Multiplying equation (10.74) by fi(i) = t gives 

(3t 2 y + y 2 t)dt + (t 3 + t 2 y)dy = 0 (10.83) 

Equation (10.83) has 

M(t,y) = 3t 2 y + y 2 t (10.84) 
N(t,y) =t 3 +t 2 y (10.85) 

This time, since 

M y = "it 2 + 2yt = N t (10.86) 
we have an exact equation. 

The solution of (10.83) is 4*(t,y) = C, where C is an arbitrary constant, 
and 

d ^=M(t,y)=Zt 2 y + ty 2 (10.87) 
^ =N(t,y) = t 3 +t 2 y (10.88) 
To find 4>(t,y) we begin by integrating (10.87) over t: 

4>(t, y)= J ^dt = J (M 2 + ty 2 )dt = t 3 y + l -t 2 y 2 + h(y) (10.89) 
Differentiating with respect to y 

^^t 3 +t 2 y + h'( y ) (10.90) 



86 



LESSON 10. INTEGRATING FACTORS 



Equating the right hand sides of (10.88) and (10.90) gives 

t 3 + t 2 y + h'(y) =t 3 + t 2 y (10.91) 

Therefore h'(y) ~ 0 and h(y) is a constant. From (10.89), general solution 
of the differential equation, which is (j) = C, is given by 

t 3 y+^t 2 y 2 = C. □ (10.92) 

Example 10.3. Solve the initial value problem 

(2y 3 +2)dt + 3ty 2 dy = 0 > \ 
2/(1) =4/ 

This has the form M (t, y)dt + N(t, y)dy with 

M(t,y) = 2y 3 + 2 (10.94) 

N(t iy ) = 3ty 2 (10.95) 

Since 

My = 6y 2 (10.96) 

N t = 3y 2 (10.97) 



To find an integrating factor, we start with 



„, , M v - N t 6y 2 - 3y 2 3y 2 1 
P(ty) = —H— — - = y - 0 y = -A- = - 10.98) 
N 3ty 2 3ty 2 t 



(10.99) 



This is only a function of t and so an integrating factor is 

fi = exp ~j;dt^J = cxp (hit) = t 

Multiplying (10.93) by fi(t) = t, 

(2ty 3 + 2t)dt + 3t 2 y 2 dy = 0 (10.100) 

which has 

M (t, y) = 2ty 3 + 2t (10.101) 
N(t,y) = 3t 2 y 2 (10.102) 

Since 

M y (t,y) =6ty 2 = N t (t,y) (10.103) 
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the revised equation (10.100) is exact and therefore the solution is </>(t, y) = 
C where 

^=M(t,y) = 2ty 3 + 2t (10.104) 

^ = N(t,y) = 3t 2 y 2 (10.105) 
dy 

Integrating (10.104) with over t, 



<P{t,y) = I -^dt + h(y) (10.106) 



(2ty 3 + 2t)dt + h{y) (10.107) 

= t 2 y 3 + t 2 + h{y) (10.108) 
Differentiating with respect to y, 

= 3t 2 y + ti(y) (10.109) 



d(f>(t,y) . ■ 



dy 

Equating the right hand sides of (10.109) and (10.105) gives 

M 2 y 2 + h'{y) = 3t 2 y 2 (10.110) 

Hence h'(y) = 0 and h(y) — C for some constant C. From (10.108) the 
general solution is 

t 2 (y 3 + l) = C (10.111) 
Applying the initial condition y(l) = 4, 

(1) 2 (4 3 + 1) = C C = 65 (10.112) 

Therefore the solution of the initial value problem (10.93) is 

t 2 (y 3 + l) = 65 □ (10.113) 

Example 10.4. Solve the initial value problem 



ydt + (2i - ye v )dy = 0 

y(o) = 1 1 



(10.114) 



Equation (10.114) has the form M(t, y)dt + N(t, y)dy = 0 with M(t, y) = y 
and N(t, y) — 2t — ye y . Since M y = 1 ^ 2 = N t the differential equation is 
not exact. We first try case 1: 

m . , MJt.y) - N t (t,y) 1 

P (1) (t,y) - vA %J^ - do-US) 
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This depends on both t and y; case 1 requires that P^'(t,y) only depend 
on t. Hence case 1 fails. Next we try case 2 

V y ' M(t,y) y V ; 

Since is purely a function of y, the conditions for case (2) are satisfied. 
Hence an integrating factor is 

H(y) = exp (^J{l/y)dy^j = exp (lny) = y (10.117) 

Multiplying equation the differential equation through n(y) = y gives 

y 2 dt + (2ty-y 2 e y )dy = 0 (10.118) 

This has 

M(t,y) = y 2 (10.119) 
N{t,y) = 2ty-y 2 e y (10.120) 

Since M y = 2y = N t , equation (10.118) is exact. Thus we know that the 
solution is <j>(t, y) = C where 

^=M(t,y)=y 2 (10.121) 

^=N(t,y) = 2ty-y 2 e y (10.122) 
dy 

Integrating (10.121) over t, 

M v)= I ii dt + %) = I v 2dt + Kv) = v H + %) ( 10 - 123 ) 



dt 

Differentiating with respect to y, 



^=2ty + h'{y) (10.124) 



Equating the right hand sides of (10.124) and (10.122), 



2yt + h'(y) 


= 2ty - y 2 e y 


(10.125) 


h'(y) 


= -y 2 e y 


(10.126) 


Ky) 


= J h'(y)dy 


(10.127) 




= - J y 2 e y dy 


(10.128) 




= -e y (2-2y + y 2 ) 


(10.129) 
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Substituting (10.129) into (10.123) gives 

^y) = y 2 t-ey(2-2y + y 2 ) (10.130) 
The general solution of the ODE is 

y 2 t + e y (-2 + 2y -y 2 ) = C (10.131) 
The initial condition y(0) = 1 gives 

C = (1 2 )(0) + e\-2 + (2)(1) - l 2 ) = -e (10.132) 
Hence the solution of the initial value problem is 

y 2 t + e v {-2 + 2y~y 2 ) = -e □ (10.133) 
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Lesson 11 



Method of Successive 
Approximations 



The following theorem tells us that any initial value problem has an equiv- 
alent integral equation form. 



(11.1) 



Theorem 11.1. The initial value problem 

y'(t,y) = f(t, y y 

y(to) = 2/0 

has a solution if and only if the integral equation 

0(*)=W)+ / f(s,<f>(s))ds (11.2) 

has the same solution. 



Proof. This is an "if and only if" theorem, so to prove it requires showing 
two things: (a) that (11.2) (11.1); and (b) that (11.1) => (11.2). 

To prove (a), we start by assuming that (11.1) is true; we then need to 
show that (11.2) follows as a consequence. 

If (11.1) is true then it has a solution y = <p{t) that satisfies 

f (11.3) 
<K*o) = 2/o 
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Let us change the variable t to s. 

dcp{s 



, f {.«,*(*)) (11-4) 
as 



If we multiply by ds and integrate from s = to to s = t, 



= jf f(8,^a))da (11.5) 

By the fundamental theorem of calculus, since 0(s) is an antiderivative of 
dcf>(s)/ds, the left hand side becomes 

1 ^ds = 4>{t) - cj>{t Q ) = 0(t) - y 0 (11.6) 

where the second equality follows from the second line of equation (11.3). 
Comparing the right-hand sides of equations (11.5) and (11.6) we find that 

m-Vo= I f(s^(s))ds (11.7) 



Bringing the yo to the right hand side of the equation gives us equation 
(11.2) which was the equation we needed to derive. This completes the 
proof of part (a). 

To prove part (b) we assume that equation (11.2) is true and need to show 
that equation (11.1) follows as a direct consequence. If we differentiate 
both sides of (11.2), 

d is* 



dt ^=dt\yo+ I f(s,<j>(s))ds) (11.8) 



dyo d 
dt dt 



f(s,(b(s))ds (11.9) 



= <t>{t,<t>{t)) (11.10) 

where the last equation follows from the fundamental theorem of calculus. 
Changing the name of the variable from (f> to y in (11.10) gives us y 1 = 
f(t,y), which is the first line (11.1). 

To prove that the second line of (11.1) follows from (11.2), we substitute 
t = to in (11.2). 

<t>(t 0 ) =yo+ 1° f(s, 4>(s))ds = yo (11.11) 
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because the integral is zero (the top and bottom limits are identical). 
Changing the label 0 to y in equation (11.11) returns the second line of 
(11.1), thus completing the proof of part (b). □ 

The Method of Successive Approximations, which is also called Pi- 
card Iteration, attempts to find a solution to the initial value problem 
(11.1) by solving the integral equation (11.2). This will work because both 
equations have the same solution. The problem is that solving the integral 
equation is no easier than solving the differential equation. 

The idea is this: generate the sequence of functions </>o, </>i, 4>2, ■ ■ ■ , defined 
by 

Mt) = Vo (11.12) 
Mt) = Vo+ [ f(s,<h{a))d8 (11.13) 

J to 

Mt) = Vo+ [ f(s,Ms))ds (11.14) 



ft 

= Vo + I f(s,<t>n(s))ds (11.15) 

o 



From the pattern of the sequence of functions, we try to determine 

4>{t) = lim <f> n (t) (11.16) 

n— >oo 

If this limit exists, then it converges to the solution of the initial value 
problem. 

Theorem 11.2. Suppose that f(t,y) and df(t,y)/dy are continuous in 
some box 

t 0 -a<t<t Q +a (11-17) 
yo-b<y<y 0 + b (11.18) 

then there is some interval 

to-a<to-h<t<t 0 + h<ta + a (11.19) 
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in which the Method of Successive Approximations converges to the unique 
solution of the initial value problem 



The proof of this theorem is quite involved and will be discussed in the 
sections 12 and 13. 

The procedure for using the Method of Successive Approximations is sum- 
marized in the following box. 1 



Procedure for Picard Iteration 

To solve y' = f(t, y) with initial condition y(to) = yg: 

1. Construct the first 3 iterations </)o, </>i, </>2, </>3- 

2. Attempt to identify a pattern; if one is not obvious you 
may need to calculate more <j) n . 

3. Write a formula for the general <fi n (t) from the pattern. 

4. Prove that when you plug <p n (t) into the right hand side of 
equation (11.15) you get the same formula for <j) n +i with 
n replaced by n + 1 . 

5. Prove that (j)(t) = linin^oo </>„ converges. 

6. Verify that <j)(i) solve the original differential equation and 
initial condition. 



1 The Method of Successive Approximations is usually referred to as Picard iteration 
for Charles Emile Picard (1856-1941) who popularized it in a series of textbooks on 
differential equations and mathematical analysis during the 1890's. These books became 
standard references for a generation of mathematicians. Picard attributed the method 
to Hermann Schwartz, who included it in a Festschrift honoring Karl Weierstrass' 70'th 
birthday in 1885. Guisseppe Peano (1887) and Ernst Leonard Lindeloff (1890) also 
published versions of the method. Since Picard was a faculty member at the Sorbonne 
when Lindeloff, also at the Sorbonne, published his results, Picard was certainly aware 
of Lindeloff's work. A few authors, including Boyce and DiPrima, mention a special 
case published by Joseph Liouville in 1838 but I haven't been able to track down the 
source, and since I can't read French, I probably won't be able to answer the question 
of whether this should be called Liouville iteration anytime soon. 




(11.20) 
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(11.21) 



Example 11.1. Construct the Picard iterates of the initial value problem 

y' = -2t»l 
i/(o) = i J 

and determine if they converge to the solution. 

In terms of equations (11.12) through (11.15), equation (11.21) has 

f(t,y) = -2ty (11.22) 

t 0 = 0 (11.23) 

2/o = 1 (11.24) 

Hence from (11.12) 

Mt) =2/o = l (11.25) 

/( S ,0o(s)) = -2s^o(s) = -2s (11.26) 

0i W =2/o+ / f(s,Ms))ds (11.27) 



= 1-2 [ sds (11.28) 
Jo 

= l-t 2 (11.29) 
We then use <j>\ to calculate f(s,<fii(s)) and then </> 2 : 

= -2s^(s) = -2s(l - ,s 2 ) (11.30) 

Mt) =2/o+ / f(s,<h.[a))da (11.31) 



= 1 - 2 / s(l- s 2 )ds (11.32) 
Jo 

= l-t 2 + V (11.33) 



Continuing as before, use 02 to calculate f(s,<p2(s)) and then 



'3: 



/(«, &(«)) = -2s0 2 (s) - -2s ^1 - s 2 + ^ (11.34) 
M*) = 2/o+ / f(s,Ms))ds (H.35) 



= 1 2 y s ( 1 - s 2 + -s 4 J ds (11.36) 

= 1 -t 2 + V - -t 6 (11.37) 
2 6 y ' 
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Continuing as before, use ^3 to calculate /(s, </>3(s)) and then 



'4: 



/(*, = -2sMs) = -2s (l - s 2 + is 4 - is 6 J 1 I I .:-JS) 

Ms)=yo+ [ f{s,<j> 3 (s))ds (11.39) 
Jo 

= 1-2 J (s - s 3 + ^s 5 - ^s 7 ^J ds (11 AO) 

= l-t 2 + + — (11.41) 

2 6 24 1 ' 

That pattern that appears to be emerging is that 

, , , t 2 -o t 21 e 2 e 3 (-i) n t 2n ^(-i) k t 2k , 

k=Q 

The only way to know if (11.42) is the correct pattern is to plug it in and 
see if it works. First of all, it works for all of the n we've already calculated, 
namely, n = 1, 2, 3, 4. To prove that it works for all n we use the principal 
of mathematical induction: A statement P(n) is true for all n if and 
only if (a) P(l) is true; and (b) P(n) => P(n— 1). We've already proven 
(a). To prove (b), we need to show that 

"+ 1 (1 \k f 2k 

^+^ = J2-^r~ ( 1L43 ) 

fc=0 

logically follows when we plug equation (11.42) into (11.15). The reason for 
using (11.15) is because it gives the general definition of any Picard iterate 
<f) n in terms of the previous iterate. From (11.15), then 

<t> n+x {t) =yo+ f f(s, cf> n (s))ds (11.44) 

Jt 0 

To evaluate (11.44) we need to know f(s, <fi n (s)), based on the expression 
for </> n (s) in (11.42): 



f(s,<l) n (s)) = -2s<f> n (s) (11.45) 

If. 
~fcT 



n I 1\fc«,2fc 



" I 1 \fc „2fe+l 
fc=0 
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We can then plug this expression for f(s,<j> n (s)) into (11.44) to see if it 
gives us the expression for </>„+i that we are looking for: 

0„ +1 (t) = l-2^i-/- / s 2k+1 ds (11.48) 
fc=0 ' ^° 

n l -i\k + 2k+2 

= i- 2 y { -^-- — (n.49) 

^ fc! 2fc+2 1 ' 

fe=0 
fc=0 

= -14(26) A^w^, 

0! + 1 j 

The trick now is to change the index on the sum. Let j = k + 1. Then 
fc = 0 =>■ j = 1 and k = n ==> j = n + 1. Hence 

-i¥26) ^ (-i)i^- 

which is identical to (11.43). This means that our hypothesis, given by 
equation (11.42), is correct: 

n (_-i\kf2k 

^(*) = E L ^r— ( n - 53 ) 



Our next question is this: does the series 

W) = Km Ut) = £ L 4i L - = E L TT L ( 1L54 ) 



fc! ^ fc! 

fc=0 fc=0 



converge? If the answer is yes, then the integral equation, and hence the 
IVP, has a solution given by 4>(t). Fortunately equation (11.54) resembles 
a Taylor scries that we know from calculus: 



oo fc 

Efr (ii-55) 

k=Q 



Comparing the last two equations we conclude that the series does, in fact, 
converge, and that 

4>{t) = e- e (11.56) 



LESSON 11. PICARD ITERATION 



Our final step is to verify that the solution found in this way actually works 
(because we haven't actually stated any theorems that say the method 
works!). First we observe that 

j t 4>{t) = j t e- e = -2ie-< 2 = -2i#) (11.57) 

which agrees with the first line of equation (11.21). To verify the initial 
condition we can calculate 

0(0) = e-W 2 = 1 (11.58) 



as required. 



□ 



Lesson 12 



Existence of Solutions* 



In this section we will prove the fundamental existence theorem. We will 
defer the proof of the uniqueness until section 13. Since we will prove 
the theorem using the method of successive approximations, the following 
statement of the fundamental existence theorem is really just a re-wording 
of theorem 11.2 with the references to uniqueness and Picard iteration 
removed. By proving that the Picard iterations converge to the solution, we 
will, in effect, be proving that a solution exists, which is why the reference 
to Picard iteration is removed. 

Theorem 12.1 (Fundamental Existence Theorem). Suppose that 
f(t, y) and df(t, y)/dy are continuous in some rectangle R defined by 

t a -a<t<t Q +a (12.1) 
yo - b < y < y 0 + b (12.2) 

Then the initial value problem 

tt^^A (12.3) 

y(to) = yo J 

has a solution in some interval 

t 0 -a<t 0 -h<t<t 0 + h<t Q +a (12.4) 



*Most of the material in this section can be omitted without loss of continuity with 
the remainder of the notes. Students should nevertheless familiarize themselves with the 
statement of theorem 12.1. 
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Results from Calculus and Analysis. We will need to use several results 
from Calculus in this section. These are summarized here for review. 

• Fundamental Theorem of Calculus. 

1. j t Jj(s)ds = f(t) 

2- £±f(s)ds = f(b)-f(a) 

• Boundedness Theorem. Suppose |/| < M and a < b. Then 
1. / f(t)dt < M(b-a) 



2- f f(t)dt< f f(t)dt < f \f(t)\dt 



Mean Value Theorem. If f(t) is diffcrentiable on [a, b] then there 
is some number c £ [a, b] such that f(b) — f(a) = f'(c)(b — a). 

Pointwise Convergence. Let A, B C R, and suppose that fk(t) ■ 
A — >• B for k = 0,1,2,... Then the sequence of functions fk,k — 
0,1,2,... is said to converge pointwise to j(t) if for every t £ A, 
lim fk(t) = f(t), and we write this as fh(t) —¥ f(t). 

k—^-oo 

Uniform Convergence. The sequence of functions fk,k — 0, 1, 2, ... 
is said to converge uniformly to f(t) if for every e > 0 there exists an 
integer N such that for every k > N, \fk(t) — f(t)\ < e for all t e A. 
Furthermore, If fk(t) is continuous and/ fe (i) — > f(t) uniformly, then 

1. f(t) is continuous. 

2. lim J Q b / fc (t)dt = J a b lim / fc (i)dt = J a b /(t)dt 

Pointwise Convergence of a Series. The series X^feLo/ fe (*) ^ s 
said to converge pointwise to s(i) if the sequence of partial sums 
s n(t) — J2k=o fk(t) converges pointwise to s(t), and we write this as 

£r=o /*(*)=*(*)■ 

Uniform convergence of a Series. The series £felo/ fe (^) ^ s sa ^ 
to converge uniformly to s(i) if the sequence of partial sums s n (t) — 
J2k=o fk(t) converges uniformly to s(t). 



101 



• Interchangeability of Limit and Summation. If Y2kLo fk(t) 
converges uniformly to s(t): Hm^fclo = Z)^=o um /fc(*) = 

SfeLo /( a ) = s ( a )- m other words, the limit of the sum is the sum of 
the limits. 5 

Approach The method we will use to prove 12.1 is really a formalization 
of the method we used in example 11.1: 

1. Since / is continuous in the box R it is defined at every point in R, 
hence it must be bounded by some number M. By theorem (12.3), / 
is Lipshitz (Definition (12.2)). In Lemma (12.4) use this observation 
to show that the Picard iterates exist in R and satisfy 

\<f>k(t)-yo\ <M\t-h\ (12.5) 

2. Defining s n (t) = [4> n (i) — 0 n _i(t)], we will show in Lemma (12.5) 
that the sequence (f>o, 4>i, 4>2, ■ ■ ■ converges if and only if the series 

oo 

S(t) = 5^a„(t) (12.6) 

n=l 

also converges. 

3. Use the Lipshitz condition to prove in Lemma (12.6) that 

\s n (t)\ = |0 n - ^ n _il < K^M ^ - | o) " (12.7) 

4. In Lemma (12.7), use equation (12.7) to show that S, defined by 
(12.6), converges by comparing it with the Taylor series for an expo- 
nential, and hence, in Lemma (12.8), that the sequence 4>q, cj)±, 02, • • ■ 
also converges to some function 4> — lim <f> n . 

n— ¥oo 

5. In Lemma (12.9), show that <f> = lim <p„ is defined and continuous 

n— foo 

on the rectangle R. 

6. Show that <p(i) satisfies the initial value problem (12.3), 

Assumptions. We will make the following assumptions for the rest of this 
section. 

1. R is a rectangle of width 2a and height 2b, centered at (to, yo). Equa- 
tions (12.1) and (12.2) follow as a consequence. 
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2. f(t,y) is bounded by some number M on a rectangle R, i.e, 



\f(t,y)\<M 

for all t, y in R. 

3. f{t,y) is diffcrcntiable on i?. 

4. df/dy is also bounded by M on R, i.e., 

0/(t,y) 



(12.8) 



9y 



< M 



5. Define the Picard iterates as <j>o(t) = yo and 



4>k{t)=yo+ \ f{s,cp k -i(s))ds 
J t 0 



(12.9) 



(12.10) 



for all k = 1,2,. ... 

Definition 12.2. Lipshitz Condition. A function f(t, y) is said to satisfy 
a Lipshitz Condition on y in the rectangle R or be Lipshitz in y on R if 
there exists some number K > 0, that we will call the Lipshitz Constant, 
such that 

\f(t, yi )-f(t,y 2 )\<K\ yi -y 2 \ (12.11) 
for all t, 2/i , 2/2 in some rectangle R. 

Example 12.1. Show that f(t,y) — ty 2 is Lipshitz on the square —1 < 
t < 1,-1 < y < 1. 

We need to find a K such that 



|/(t, p) -/(*,<?) I <A1p-g| 



for f(t,y) = ty 2 , i.e., we need to show 



\t P 2 - tq 2 \ <K\p-q\ 



But 



\tp 2 - tq 2 \ = \t(p - q)(p + q)\ 
so we need to find a K such that 

\t(p-q)(p + q)\<K\p-q\ 
\t\\p + q\ < K 



(12.12) 

(12.13) 
(12.14) 

(12.15) 
(12.16) 
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But on the square — 1 < £ < 1, — 1 < y < 1, 

\t\\p + q\ < 1 x 2 = 2 



(12.17) 



So we need to find a K > 2. We can pick any such K, e.g., K = 2. Then 
every stop follows as a consequence reading from the bottom (12.16) to the 
top (12.13). Hence / is Lipshitz. □ 

Theorem 12.3. Boundedness => Lipshitz. If f(t, y) is continuously 
differentiable and there exists some positive number K such that 



dy 



< K 



(12.18) 



for all y,y € R (for some rectangle R), then / is Lipshitz in y on R with 
Lipshitz constant K. 

Proof. By the mean value theorem, for any p, q, there is some number c 
between p and q such that 



d ... . f(t,p)-f(t,q) 
dy p-q 



By the assumption (12.18), 



f(t,p)-f(t,q) 



p-q 



< K 



hence 



\f(t,p)-f(t,q)\ <K\p-q\ 
for all p, q, which is the definition of Lipshitz. Hence / is Lipshitz. 



(12.19) 

(12.20) 

(12.21) 
□ 



Example 12.2. Show that f{t,y) = ty 2 is Lipshitz in — 1 < t < 1, — 1 < 

y < l- 

Since 

Of 



dy 



= \2ty\ <2xl<l = 2 



on the square, the function is Lipshitz with K = 2. 



(12.22) 

□ 



Lemma 12.4. If / is Lipshitz in y with Lipshitz constant K, then each of 
the 4>i(t) are defined on R and satisfy 



\<j> k (t)-yo\ <M\t-to\ 



(12.23) 
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Proof. For k = 0, equation says 

\Mt)-Va\ < M\t-to\ 



(12.24) 



Since <j>o(t) = y 0 , the left hand side is zero, so the right hands side, being 
an absolute value, is > 0. 

For k > 0, prove the Lemma inductively. Assume that (12.23) is true and 
use this prove that 

\tf>u+i{t) - yo\ <M\t-t 0 \ 



From the definition of 4>k (see equation (12.10)), 



<j) k +i{t) = yo + / f(s,<f> k (s))ds 



\<j>k+i(t) - Vol 



f(s,<p k (s))ds 



< / \f(s,4> k (s))\ds 

Jto 

< [ Mds 

Jt 0 



M\t-t 



0 



which proves equation (12.25). 



(12.25) 

(12.26) 

(12.27) 

(12.28) 

(12.29) 
(12.30) 
□ 



Lemma 12.5. The sequence (fro, 4>i, <t>2> • ■ ■ converges if and only if the 
series 



S(i) = £> n (i) 



k=l 



also converges, where 



Proof. 



4>n{t) = 4>o + {4>i - 4>o) 

n 

E 



(«/» 



n ~ <Pn-l 1 



k=l 



^>0 + 5Z S »W 



(12.31) 
(12.32) 

(12.33) 
(12.34) 

(12.35) 



k=l 
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Thus 



lim 6 n = 



■n = 9o 



lim V a n (t) = 0o + V s n (t) = <j>o + S(t) (12.36) 



fc=l 



fe=l 



The left hand side of the equation exists if and only if the right hand side 
of the equation exists. Hence lim,^^ <f) n exists if and only if S{t) exists, 
i.e, S(t) converges. □ 

Lemma 12.6. With s n , K, and M as previously defined, 



|*»(*)| = \4>n ~ 4>n-l\ < K^M^-^- 

T).l 



(12.37) 



Proof. For n = 1, equation (12.37) says that 

\ 9l -M<K 0 M\^^=M\t-t 0 \ (12.38) 

We have already proven that this is true in Lemma (12.4). 

For ri > 1, prove inductively. Assume that (12.37) is true and then prove 
that 

\<f>n+i ~ <f>n\ < K n M 10 ' (12.39) 



(n + iy. 



Using the definition of <j) n and 



>n+l, 



\9n 



+ 1 - <Pn\ 



2/0+/ f(s,(t> n +i{s))ds-y 0 - f(s,(j) n (s))ds 



[f(s, (j> n+1 (s))ds - f(s, <f) n (s))]ds 



to 



< / \f(s,<t>n+l(s))ds - f(s,(j> n (s))\ds 



In 



< / K\(j> n+ i(s) - (j> n (s)\ds 



(12.40) 
(12.41) 
(12.42) 
(12.43) 



to 



where the last step follows because / is Lipshitz in y. Substituting equation 
(12.37) gives 



\<t>n+l ~ <t>n\ < -K I i^M ^ 3 f ol " rf a 



K n M 

71 ' 



\s-ta\ n ds 



to 



K n M \t - t 0 
n\ n + 1 



n+l 



(12.44) 
(12.45) 
(12.46) 
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which is what we wanted to prove (equation (12.39)). 
Lemma 12.7. The series S(t) converges. 

Proof. By Lemma (12.6) 

oo oo i _ , n 



□ 



n=l 



71=1 



M^\K(t-t 0 )\ n 



K 

_ M 

~ 1c 

_ M 

~ ~K 

M 
< — e 
- K 



E 



n=l 



n 



\n=0 

/ e JCJ*-*o| _ ^ 
Jf|t-to| 



(12.47) 
(12.48) 

(12.49) 

(12.50) 
(12.51) 



Since each term in the series for S is absolutely bounded by the correspond- 
ing term in the power series for the exponential, the series S converges 
absolutely, hence it converges. □ 

Lemma 12.8. The sequence <fio, <pi, <j>2, ■ ■ ■ converges to some limit <f>(t). 

Proof. Since the series for S(t) converges, then by Lemma (12.5), the se- 
quence 0o, 0i, • ■ ■ converges to some function <p(t). □ 

Lemma 12.9. <j)(t) is defined and continous on R. 
Proof. For any s, t, 



\<t>n{s) ~ <t>n{t)\ 



to 



f(x,<p n (x))dx - I f(x,4> n (x))dx 
f(x,(f) n (s))dx 



< 



Mdx 
M\s-t\ 



(12.52) 

(12.53) 

(12.54) 
(12.55) 



Hence taking the limit, 



lim |0„(s)-0„(i)| < Af|«-t| 



(12.56) 
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because the right hand side does not depend on n. But since </>„ — > <f>, the 
left hand side becomes \<j>{s) — </>(i)|, i.e, 

\(p(s) - 4>(t)\ <M\s-t\ (12.57) 

To show that <p{t) is continuous we need to show that for every e > 0, there 
exists a 5 > 0 such that whenever \s — 1\ < S, then \4>(s) — <fi(t)\ < e. 

Let e > 0 be given and define 5 — e/M. Then 

\s-t\<8 \4>(s) - 0(f) | < M\s - f| < MS = e (12.58) 
as required. Hence 4>(t) is continuous. □ 

Proof of the Fundamental Existence Theorem (theorem (12.1)). We 
have already shown that the sequence <p n — > <fi converges to a continuous 
function on R. To prove the existence theorem we need only to show that 
4> satisfies the initial value problem (12.3), or equivalently, the integral 
equation 

r t 

(12.59) 



(12.60) 



<Kt)=Vo+ I f{s^(s))ds 
Let us define the function 



F(t) = j/o 



/ f{8,<K8))d6 
Jto 



Since F(to) = yo, F satisfies the initial condition, and since 
F'(<) = /(i,0(i)) = 0'(t) 



(12.61) 



F also satisfies the differential equation. If we can show that F(t) = <j>(t) 
then we have shown that 6 solves the IVP. 



We consider the difference 



\F(t) - 4> n+1 (t)\ = 



yo 



f(s,<f>(s))ds - y 0 



to 



f(a,<j) n (s))ds 



to 



< 



\f(8,^8))-f{8,Ms))\d8 



<K / |0( s )-0„( s )|ds 



(12.62) 
(12.63) 
(12.64) 
(12.65) 
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where the last step follows from the Lipshitz condition. Taking limits 

lim \F(t) -<t> n +i{t)\ < lim K f \<j>(s) - <f> n (s)\ ds (12.66) 



But since (j) n — > 0, 



\F(t) - <j>(t)\ < K [ \<f>(s)-<j> { s)\ds = 0 (12.67) 

Since the left hand side is an absolute value it must also be greater then or 
equal to zero: 

0 < \F(t) - </>(t)\ < 0 (12.68) 

Hence 

|F(t)-0(t)|=O => F(t) = <j>(t) (12.69) 

Thus <f) satisfies the initial value problem. □ 



Lesson 13 

Uniqueness of Solutions 



Theorem 13.1. Uniqueness of Solutions. Suppose that y = <f>{t) is a 

solution to the initial value problem 



y'(t) = f(t, y ) 

2/(0) - to 



(13.1) 



where f(t, y) and df(t, y)/dy are continuous on a box R defined by 

t 0 -a<t<t Q + a (13.2) 
yo - b < y < y 0 + b (13.3) 

The the solution y = (f>(t) is unique, i.e., if there is any other solution 
y = ip(t) then <fi(t) = ip(t) for all t G R. 

The following example illustrates how a solution might not be unique. 
Example 13.1. There is no unique solution to the initial value problem 

At) - Vv\ 

2/(1) = 1 J 

Of course we can find a solution - the variables are easily separated, 

f y~ 1/2 dy = j dt (13.5) 
2y 1 l 2 =t + C (13.6) 
y=\{t + Cf (13.7) 
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(13.4) 
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From the initial condition, 

l = \(l + C) 2 (13.8) 

When we solve for C we get two possible values: 

(1 + C) 2 =4 (13.9) 
l + C* = ±\/4 = ±2 (13.10) 
C = ±2 - 1 = 1 or - 3 (13.11) 

Using these in equation (13.7) gives two possible solutions: 

yi = \{t+ If (13.12) 
V2 = \{t-i) 2 (13.13) 

It is easily verified that both of these satisfy the initial value problem. In 
fact, there are other solutions that also satisfy the initial value problem, 
that we cannot obtain by the straightforward method of integration given 
above. For example, if a < —1 then 

* < a 

a<t<-l (13.14) 
t > -1 

is also a solution (you should verify this by (a) showing that it satisfies the 
initial condition; (b) differentiating each piece and showing that it satisfies 
the differential equation independently of the other two pieces; and then 
showing that (c) the function is continuous at t — a and t = — 1. 




Va = < 0, 

U(t+D 2 , 



The different non-unique solutions are illustrated in the figure above; they 
all pass through the point (1,1), and hence satisfy the initial condition. □ 



Ill 



The proof of theorem (13.1) is similar to the following example. 
Example 13.2. Show that the initial value problem 

y'(t,y)=ty) 

y(o) = i J 

has a unique solution on the interval [—1, 1]. 
The solution itself is easy to find; the equation is separable. 

dy 

y 



(13.15) 



tdt 



V 



(13.16) 



The initial condition tells us that C = 1, hence y = e* 1 2 . 
The equivalent integral equation to (13.15) is 



(13.17) 



y(t) = ya+ f(s,y(s))ds 

Since f(t,y) = ty, t 0 = 0, and y Q = 1, 

y(t) = 1 + / sy{s)ds 
Jo 

Suppose that z(t) is another solution; then z(t) must also satisfy 

z(t) = 1 + / sz(s)ds (13.19) 



(13.18) 



To prove that the solution is unique, we need to show that y(t) = z{t) 
for all t in the interval [— 1, 1]. To do this we will consider their difference 
8{t) = \z{t) — y{t)\ and show that is must be zero. 



6(t) = \z(t)-y(t)\ 



1+ sz(s)ds - 1 



sy(s)ds 



< 



< 



[sz(s)ds — sy(s)]ds 



\s\\z(s) - y(s)\ds 



\z(s) ~ y(s)\ds 



6(s)ds 



(13.20) 
(13.21) 

(13.22) 

(13.23) 

(13.24) 

(13.25) 
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where the next-to-last step follows because inside the integral \s\ < 1. 
Next, we define a function F(t) such that 

F(t) = ( 6(s)ds (13.26) 
Jo 

Since F is an integral of an absolute value, 

F{t) > 0 (13.27) 

Then 

F'(t) = - \ 5(s)ds = 6(t) (13.28) 
dt Jq 

Since by equation (13.25) S(t) < F(t), we arrive at 

F'(t) = 6(t) < F{t) (13.29) 

Therefore 

F'{t) - F[t) < 0 (13.30) 

From the product rule, 

l[e-tF(t)]=e- t F'(t)-e- t F(t) (13.31) 

= e- t [F'{t)~F{t)] (13.32) 
< 0 (13.33) 

Integrating both sides of the equation from 0 to t, 

r* d 

/ — [e- s F(s)ds] < 0 (13.34) 
Jo dt 

e- l F{t) ~ e°F{0) < 0 (Fund. Thm. of Calc.) (13.35) 

e~ l F{t) < 0 (F(0)=0) (13.36) 

F(t) < 0 (divide by the exponential) (13.37) 

Now compare equations (13.27) and (13.37); the only consistent conclusion 
is that 

F{t) = 0 (13.38) 



for all t. Thus 



5{s)ds = 0 (13.39) 
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But S(t) is an absolute value, so it can never take on a negative value. The 
integral is the area under the curve from 0 to t. The only way this area can 
be zero is if the 

S(t) = 0 (13.40) 

for all t. Hence 

z(t) = y{t) (13.41) 

for all t. Thus the solution is unique. □ 

Theorem 13.2. Gronwall Inequality. Let /, g be continuous, real func- 
tions on some interval [a, b] that satisfy 

f(t)<K+ f f(s)g(s)ds (13.42) 

J a 

for some constant K > 0. Then 

/(<) < ifexp Qf g(s)ds^ (13.43) 

Proof. Define the following functions: 

F(t) = K + f f{s)g{s) (13.44) 

J a 

G{t) = I g{s)ds (13.45) 

J a 

Then 

F(a) = K (13.46) 

G{a) = 0 (13.47) 

F'{t) = f(t)g(t) (13.48) 

G'(t)=g(t) (13.49) 

By equation (13.42) we are given that 

fit) < F(t) (13.50) 

hence from equation (13.48) 

F'(t) = f(t)g(t) < F(t)g(t) = F(t)G'(t) (13.51) 
where the last step follows from (13.49). Hence 

F'(t) - F(t)G'(t) < 0 (13.52) 
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By the product rule, 



: F'(t)e- G ^ - F{t)G'{i)e~ G ^ 
: [F'(t)-F(t)G'(t)]e- G W 



< 0 

Integrating the left hand side of (13.53) 
f« d 



ds 



F(s) 



-G(s) 



ds = F(t)< 



-G(t) 



F(a)t 



-G(a) 



= F{t)e- G(t) - K 

Since the integral of a negative function must be negative, 

F{t)e~ G{t) - K < 0 

F(t)e- G ^ < K 
F{t) < Ke G(t) 

which is equation (13.43). 



(13.53) 

(13.54) 
(13.55) 



(13.56) 
(13.57) 

(13.58) 

(13.59) 
(13.60) 
□ 



y(t) = ya + / f(s,y(s))ds 

Jto 

z(t) =yo+/ f(s, z(s))ds 

Jto 



Proof of Theorem (13.1) Suppose that y and z are two different solutions 
of the initial value problem. Then 

(13.61) 
(13.62) 

\y{t)-z{t)\= f f(s,y(s))ds - [ f(s,z(s))ds (13.63) 

Jt 0 Jt 0 

ft 

(13.64) 
(13.65) 



Therefore 



to 



[f(s,y(s))-f(s,z(s))]ds 



< / \f(s,y(s))-f( S ,z(s))\ds 



Since \df/dy\ is continuous on a closed interval it is bounded by some 
number M, and hence / is Lipshitz with Lipshitz constant M. Thus 



\f(s,y(s))-f(s,z(s)\ < M\y(s) - z(s)\ 



(13.66) 
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Substituting (13.6G) into (13.65) 

\y(t) - z(t)\ < M I \y(s) - z(s)\ds (13.67) 

Let 



to 



f(t) = \y(t)-z(t)\ (13.68) 

Then 

/(*) < M f f(s)ds (13.69) 

J to 

Then / satisfies the condition for the Gronwall inequality with K = 0 and 
g(t) = M, which means 

f(t)<Kexpf g(s)ds = 0 (13.70) 

J a 

Since f(t) is an absolute value it can never be negative so it must be zero. 

0 = f(t) = \y(t) - z(t)\ (13.71) 

for all t. Hence 

y(t) = z(t) (13.72) 
for all t. Thus any two solutions are identical, i.e, the solution is unique. □ 
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Lesson 14 



Review of Linear Algebra 



In this section we will recall some concepts from linear algebra class 

Definition 14.1. A Euclidean 3-vector v is object with a magnitude 
and direction which we will denote by the ordered triple 

v=(x,y,z) (14.1) 

The magnitude or absolute value or length of the v is denoted by the 
postitive square root 

v = l v l = V% 2 +y 2 +z 2 (14.2) 

This definition is motivated by the fact that v is the length of the line 
segment from the origin to the point P = (x, y, z) in Euclidean 3-space. 

A vector is sometimes represented geometrically by an arrow from the origin 
to the point P = (x, y, z), and we will sometimes use the notation (x, y, z) 
to refer either to the point P or the vector v from the origin to the point 
P. Usually it will be clear from the context which we mean. This works 
because of the following theorem. 

Definition 14.2. The set of all Euclidean 3-vectors is isomorphic to the 
Euclidean 3-space (which we typically refer to as R 3 ). 

If you are unfamiliar with the term isomorphic, don't worry about it; just 
take it to mean "in one-to-one correspondence with," and that will be 
sufficient for our purposes. 
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Definition 14.3. Let v = (x,y,z) and w = (x',y',z') be Euclidean 3- 
vectors. Then the angle between v and w is defined as the angle between 
the line segments joining the origin and the points P = (x, y, z) and P' = 
(x>,y>,z>). 

We can define vector addition or vector subtraction by 

v + w = (x, y, z) + (x', y', z) = (x + x , y + y' , z + z) (14-3) 

where v = (x,y,z) and w = (x',y',z'), and scalar multiplcation (multi- 
plication by a real number) by 

fcv = (kx, ky, kz) (14-4) 

Theorem 14.4. The set of all Euclidean vectors is closed under vector 
addition and scalar multiplication. 

Definition 14.5. Let v = (x,y, z),w = (x',y',z') be Euclidean 3-vectors. 
Their dot product is defined as 

v • w = xx 1 + yy 1 + zz' (14-5) 

Theorem 14.6. Let 9 be the angle between the line segments from the 
origin to the points (x,y, z) and (x 1 ,y' ,z') in Euclidean 3-space. Then 

vw = |v||w|cos0 (14.6) 

Definition 14.7. The standard basis vectors for Euclidean 3-space are 
the vectors 

i =(1,0,0) (14.7) 
j =(0,1,0) (14.8) 
k =(0,0,1) (14.9) 

Theorem 14.8. Let v = (x, y, z) be any Euclidean 3-vector. Then 

v = iz+jy + kz (14.10) 

Definition 14.9. The vectors vi, v 2 , . . . ,v„ are said to be linearly de- 
pendent if there exist numbers a\, a,2, ■ ■ ■ , a n , not all zero, such that 

aivi + a 2 v 2 H h a„v„ = 0 (14.11) 

If no such numbers exist the vectors are said to be linearly independent. 
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Definition 14.10. An mxn (or m by n) matrix A is a rectangular array 
of number with m rows and n columns. We will denote the number in the 
i th row and j th column as o^ 



/ an 
a2i 



ai2 

022 



ain\ 

02r 



(14.12) 



\"ml ffi m2 ' ' ' a m 

We will sometimes denote the matrix A by [a^]. 

The transpose of the matrix A is the matrix obtained by interchanging 
the row and column indices, 



'■jt 



(14.13) 



or 



[a l3 ] T = [ aji ] (14.14) 

The transpose of an m x n matrix is an n x m matrix. We will sometimes 
represent the vector v = (x, y, z) by its 3x1 column- vector representation 



(14.15) 



or its 1 x 3 row- vector representation 

v T = (x y 



0 



(14.16) 



Definition 14.11. Matrix Addition is defined between two matrices of 
the same size, by adding corresponding elemnts. 



fan 012 - A 

°21 a 22 



V : 



hi 
V : 



bi2 

b22 



I an + &n &22 + h2 

a 21 + °21 a 22 + ^22 

V : 



Matrices that have different sizes cannot be added. 



(14.17) 



Definition 14.12. A square matrix is any matrix with the same number 
of rows as columns. The order of the square matrix is the number of rows 
(or columns). 

Definition 14.13. Let A be a square matrix. A submatrix of A is the 

matrix A with one (or more) rows and/or one (or more) columns deleted. 
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Definition 14.14. The determinant of a square matrix is defined as 
follows. Let A be a square matrix and let n be the order of A. Then 

1. If n = 1 then A = [a] and det A = a. 

2. If n > 2 then 

n 

detA = J2a k i(-l) i+k det(A' ik ) (14.18) 

for any k — l,..,n, where by A\ k we mean the submatrix of A with the 
i th row and k th column deleted. (The choice of which k does not matter 
because the result will be the same.) 



We denote the determinant by the notation 



detA 



an a 12 

0>21 «22 



(14.19) 



In particular, 



a b 
c d 



= ad — bc 



and 



ABC 
D E F 
G H I 



A 



E 


F 


- B 


D 


F 


+ C 


D 


E 


H 


I 


G 


I 


G 


H 



(14.20) 



(14.21) 



Definition 14.15. Let v — (x,y,z) and w — (x',y',z') be Euclidean 3- 
vectors. Their cross product is 



v x w 



i J k 

x y z 
x' y' z 



(yz' - y'z)\ - (xz' - x'z)j + (xy' - x'y)k (14.22) 



Theorem 14.16. Let v = (x,y,z) and w = (x',y',z') be Euclidean 3- 
vectors, and let 9 be the angle between them. Then 



|v x v| = Ivllwl sin 8 



(14.23) 



Definition 14.17. A square matrix A is said to be singular if dct A = 0, 
and non-singular if dct A ^ 0. 



Theorem 14.18. The n columns (or rows) of an n x n square matrix A 
are linearly independent if and only if detA ^ 0. 
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Definition 14.19. Matrix Multiplication. Let A = [ay] be an m x r 
matrix and let B = [bij] be an r x n matrix. Then the matrix product is 
defined by 

r 

[AB]ij = ciikbkr = rowi(A) ■ columnjS (14.24) 

fc=i 

i.e., the ij th element of the product is the dot product between the i th row 
of A and the j th column of B. 



Example 14.1. 




(1,2, 3) -(8, 10, 12) (1,2, 3) -(9, 11, 13) 
(4, 5, 6) -(8, 10, 12) (4, 5, 6) -(9, 11, 13) 

(14.25) 

1 ™ 9 ) □ 



Note that the product of an [n x r] matrix and an [r x m] matrix is always 
an [n x m] matrix. The product of an [n x r] matrix and and [s x n] is 
undefined unless r = s. 

Theorem 14.20. If A and B are both n x n square matrices then 

dct AB = (dct A) (dct B) (14.27) 

Definition 14.21. Identity Matrix. The n x n matrix / is defined as 
the matrix with l's in the main diagonal an, (I22, • • • , a m m an d zeroes 
everywhere else. 

Theorem 14.22. / is the identity under matrix multiplication. Let A be 
any n x n matrix and / the n x n Identity matrix. Then AI = I A = A. 

Definition 14.23. A square matrix A is said to be invertible if there 
exists a matrix A -1 , called the inverse of A, such that 

AA- 1 = A- 1 A = I (14.28) 

Theorem 14.24. A square matrix is invertible if and only if it is nonsin- 
gular, i.,e, det A 7^ 0. 

Definition 14.25. Let A = [ay] be any square matrix of order n. Then 
the cofactor of ay, denoted by cof ay, is the (—l) l+J det My where My 
is the submatrix of A with row i and column j removed. 
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Example 14.2. Let 

(l 2 3\ 

(14.29) 




Then 



Cof (Zi2 = (-1) 



1 + 2 



4 6 
7 9 



(-l)(36-42) =6 □ (14.30) 



Definition 14.26. Let A be a square matrix of order n. The Clasical 

Adjoint of A, denoted adj A, is the transopose of the matrix that results 
when every element of A is replaced by its cofactor. 

Example 14.3. Let 

/l 0 3\ 

A = 4 5 0 (14.31) 
\0 3 1) 

The classical adjoint is 

adj A — Transpose 

(1)[(1)(5) - (0)(3)] (-1)[(4)(1) - (0)(0)] (1)[(4)(3) - (5)(0)] \ 
(-1)[(0)(1) - (3)(3)] (1)[(1)(1) - (3)(0)] (-1)[(1)(3) - (0)(0)] 
(1)[(0)(0) - (3)(5)] (-1)[(1)(0) - (3)(4)] (1)[(1)(5) - (0)(4)] / 

(14.32) 

5 9 -15> 

Transpose | 9 1 -3 ) = | -4 1 12 | □ (14.33) 

12 

Theorem 14.27. Let A be a non-singular square matrix. Then 

A-> = ^adj A (14.34) 

Example 14.4. Let A be the square matrix defined in equation 14.31. 
Then 

detA= 1(5-0) -0 + 3(12-0) =41 (14.35) 

Hence 

1 / 5 9 -15\ 

□ (14.36) 
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In practical terms, computation of the determinant is computationally in- 
efficient, and there are faster ways to calculate the inverse, such as via 
Gaussian Elimination. In fact, determinants and matrix inverses are very 
rarely used computationally because there is almost always a better way to 
solve the problem, where by better we mean the total number of computa- 
tions as measure by number of required multiplications and additions. 

Definition 14.28. Let A be a square matrix. Then the eigenvalues of A 

are the numbers A and eigenvectors v such that 



Av = Av 



(14.37) 



Definition 14.29. The characteristic equation of a square matrix of 
order n is the n th order (or possibly lower order) polynomial 



det(A — XI) = 0 



(14.38) 



Example 14.5. Let A be the square matrix defined in equation 14.31. 
Then its characteristic equation is 



0 = 



1 - A 0 3 
4 5- A 0 
0 3 1 - A 



= (1 - A)(5 - A)(l - A) - 0 + 3(4)(3) 



41 - 11A + 7A 2 



A" 



□ 



(14.39) 

(14.40) 
(14.41) 



Theorem 14.30. The eigenvalues of a square matrix A are the roots of 
its characteristic polynomial. 

Example 14.6. Let A be the square matrix defined in equation 14.31. 
Then its eigenvalues are the roots of the cubic equation 

41 - 11A + 7A 2 - A 3 = 0 (14.42) 

The only real root of this equation is approximately A « 6.28761. There are 
two additional complex roots, A ss 0.356196 — 2.52861* and A « 0.356196 + 
2.5286H. 

Example 14.7. Let 




(14.43) 
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Its characteristic equation is 

-2 



0 = 



2 - A 
1 
1 



1-A 
3 



3 
1 

-1-A 



= (2 - A)[(l - A)(-l - A) - 3] + 2[(-l - A) - 1] 

+ 3[3-(l-A)] 
= (2 - A)(-l + A 2 - 3) + 2(-2 - A) + 3(2 + A) 
= (2 - A)(A 2 - 4) - 2(A + 2) + 3(A + 2) 



(2- A)(A + 2)(A-2) + (A- 
(A + 2)[(2- A)(A-2) + l] 
(A + 2)(-A 2 +4A-3) 
-(A + 2)(A 2 -4A + 3) 
-(A + 2)(A-3)(A- 1) 



2) 



(14.44) 

(14.45) 
(14.46) 
(14.47) 
(14.48) 
(14.49) 
(14.50) 
(14.51) 
(14.52) 
(14.53) 



Therefore the eigenvalues are -2, 3, 1. To find the eigenvector corresponding 
to -2 we would solve the system of 




(14.54) 



for x, y, z. One way to do this is to multiply out the matrix on the left and 
solve the system of three equations in three unknowns: 



2x - 2y + 3z 
x + y + z 
x + 3y — z 



-2x 

-2y 

-2z 



(14.55) 
(14.56) 
(14.57) 



However, we should observe that the eigenvector is never unique. For ex- 
ample, if v is an eigenvector of A with eigenvalue A then 



A(kv) = kAv = fcAv 



(14.58) 



i.e., fcv is also an eigenvalue of A. So the problem is simplified: we can 
try to fix one of the elements of the eigenvalue. Say we try to find an 
eigenvector of A corresponding to A = — 2 with y = 1. Then we solve the 
system 



2.x - 2 + 3z = -2x 
x + 1 + z = -2 
x + 'A- z = -2z 



(14.59) 
(14.60) 
(14.61) 
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Simplifying 



Ax - 2 + 3z = 0 
x+3+z=0 
x+3+z=0 



(14.62) 
(14.63) 
(14.64) 



The second and third equations are now the same because we have fixed 
one of the values. The remaining two equations give two equations in two 
unknowns: 



The solution is x = 11, z — — 14. Therefore an eigenvalue of A correspond- 
ing to A = —2 is v = (11, 1, —14), as is any constant multiple of this vector. 
□ 

Definition 14.31. The main diagonal of a square matrix A is the list 



Definition 14.32. A diagonal matrix is a square matrix that only has 
non-zero entries on the main diagonal. 

Theorem 14.33. The eigenvalues of a diagonal matrix are the elements 
of the diagonal. 

Definition 14.34. An upper (lower) triangular matrix is a square 
matrix that only has nonzero entries on or above (below) the main diagonal. 



4a; + 3z = 2 



x + z 



= -3 



(14.65) 
(14.66) 



(an, fl22, • • ■ , a nn ). 



Theorem 14.35. The eigenvalues of an upper (lower) triangular matrix 
line on the main diagonal. 
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Lesson 15 



Linear Operators and 
Vector Spaces 



Definition 15.1. A Vector Space over 1R 1 is a set V combined with two 
operations addition (denoted by x + y, y, y G V) and scalar 2 multiplica- 
tion (denoted bycxi/orc!/,ieR,!/eV). with the following properties: 



1. Closure under Addition and Scalar Multiplication 

y,z eV => y + zeV 
t G M, y G V tyeV 



w,y,z £ V =>■ (io + y) + z = w + (y + z) 
a,b eR,y eV =^ (ab)y = a(by) 



1 This definition generalizes with M replaced by any field. 
2 A scalar is any real number or any real variable. 



(15.1) 



2. Commutativity of Addition 

y, zeV =^ y+z=z+y (15.2) 

3. Associativity of Addition and Scalar Multiplication 



(15.3) 



4. Additive Identity. There exists a 0 G V such that 

yeV y + 0 = 0 + y = y (15.4) 
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5. Additive Inverse. For each y e V there exists a —y G V such that 

tf + (-y) = (-l/) + y = 0 (15.5) 

6. Multiplicative Identity. For every y e V, 

lxy = yxl = y (15.6) 

7. Distributive Property. For every o,/»eR and every y, z e V, 

a(y + z) = ay + az 
(a + 6)2/ = ay + by 

Example 15.1. The usual Euclidean 3D space forms a vector space, where 
each vector is a triple of numbers corresponding to the coordinates of a point 

v = (x,y,z) (15.8) 

If w — (p, q, r) then addition of vectors is defined as 

v + w = (x +p, y + q,r + z) (15.9) 

and scalar multiplication is given by 

av = (ax , ay , az) (15.10) 

You should verify that all seven properties hold. □ 

We are particularly interested in the following vector space. 

Example 15.2. Let V be the set of all functions y(t) defined on the real 
numbers. Then V is a vector space under the usual definitions of addition 
of functions and multiplication by real numbers. For example, if / and g 
are functions in V then 

h(t) = f(t)+g(t) (15.11) 
is also in V, and if c is a real number, then 

p(t) = cf(t) (15.12) 

is also in V. To see that the distributive property holds, observe that 

a(f(t)+g(t))=af(t) + bg(t) (15.13) 
(a + b)f(t)=af(t) + bft(t) (15.14) 

You should verify that each of the other six properties hold. □ 
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Example 15.3. By a similar argument as in the previous problem, the set 
of all functions 

f(t) : R n -> R m (15.15) 

is also a vector space, using the usual definitions of function addition and 
multiplication by a constant. 

Definition 15.2. Let V be a vector space. Then a norm on V is any 

function \\y\\ : V — > R (i.e., it maps every vector y in V to a real number 
called 1 1 y| |) such that 

1. > 0 and Hj/II =0 2/ = 0. 

2. \\cy\\ — \c\\\y\\ for any real number c, vector y. 

3- ||y + z\\ < \\y\\ + \\z\\ for any vectors y, z. (Triangle Inequality) 

A normed vector space is a vector space with a norm defined on it. 
Example 15.4. In the usual Euclidean vector space, the 2-norm, given by 



||v|| = V* 2 +V 2 + z 2 (15.16) 

where the positive square root is used. You probably used this norm in 
Math 280. □ 

Example 15.5. Another norm that also works in Euclidean space is called 
the sup-norm, defined by 

Hwlloo =max(|a:|,| ! /|,|2f|) (15.17) 
Checking each of the three properties: 

1. |H|oo is an absolute value, so it cannot be negative. It can only be 
zero if each of the three components x = y = z = 0, in which case 
v = (0, 0, 0) is the zero vector. 



2. This follows because 



\cv\\oo = ||c(a;,t/,2)||cx> (15.18) 

= \\(cx,cy,cz))\\ 00 (15.19) 

= max(|cx|, \cy\, \cz\) (15.20) 

= |c|max(|x|,|2/|,|z|) (15.21) 

= |c||H|oo (15.22) 
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3. The triangle follows from the properties of real numbers, 

||v + w||oo = \\(x+p,y + q,z + r)\\ (15.23) 

= max(\x+p\,\y + q\,\z + r\) (15.24) 

<max(|a!| + |p|,|y| + | ? |,M + |r|) (15.25) 

because \x +p\ < \x\ + \p\, etc. Hence 

||v + tulU < max(\x\, \y\, \z\) + waxQp\, \q\, \r\) (15.26) 

= Nloo + Hloo (15-27) 

Thus Halloo is a norm. □ 

Example 15.6. Let V be the set of all functions y(t) defined on the interval 
0 < t < 1. Then 

IMI = (f W)\ 2 d?j (15.28) 

is a norm on V. 

The first property follows because the integral of an absolute value is a 
positive number (the area under the curve) unless y(t) — 0 for all t, in 
which case the area is zero. 

The second property follows because 

IMI = (Y \cy(t)\ 2 dt) ' = |c| \y(t)\ 2 dtj ' = \c\U\ (15-29) 

The third property follows because 

||y + z|| 2 = / \y(t)+z(t)\ 2 dt (15.30) 

\y{i) 2 + 2y{t)z(t) + z{tf\dt (15.31) 

/ \y(t)\ 2 dt + 2 I' \y(t)\\z(t)\dt+ f 1 \z(t)\ 2 dt (15.32) 



By the Cauchy Schwarz Inequality 3 



y{t)z(t)dt 



< \y(t)\ 2 dt \z(t)\'dt =\\y\\ 2 \\z\\ 2 (15.33) 



3 The Cauchy-Schwarz inequality is a property of integrals that says exactly this for- 
mula. 
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Therefore 

h + z\\ 2 < ||y|| 2 + 2||y||||z|| + ||z|| 2 = (Ibll + ||z||) 2 (15.34) 
Taking square roots of both sides gives the third property of norms. □ 

Example 15.7. Let V be the vector space consisting of integrable functions 
on an interval (a, b), and let / e V. Then the sup-norm defined by 

||/|U=sup{|/(i)| :te (a,b)} (15.35) 

is a norm. 

The first property follows because it is an absolute value. The only way 
the supremum of a non-negative function can be zero is if the function is 
identically zero. 

The second property follows because sup \cf(t)\ — \c\ sup \f(t)\ 

The third property follows from the triangle inequality for real numbers: 

\f(t)+g(t)\<\f(t)\ + \.f(t)\ (15.36) 

Hence 

\\f + g\\=sup\f(t)+g(t)\ <sup|/(t)|+sup|/(t)| - U/II + NI □ (15.37) 

Definition 15.3. A Linear Operator is a function I: VhV whose do- 
main and range are both the same vector space, and which has the following 
properties: 

1. Additivity. For all vectors y,z G V, 

L(y + z) = L(y) + L(z) (15.38) 

2. Homogeneity. For all numbers a and for all vectors y e V, 

L(ay) - aL(y) (15.39) 

These two properties are sometimes written as 

L(ay + bz) = aL{y) + bL(z) (15.40) 

It is common practice to omit the parenthesis when discussing linear oper- 
ators. 
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Definition 15.4. If y, z are both elements of a vector space V, and A and 
B are any numbers, we call 

w = Ay + Bz (15.41) 
a Linear Combination of y and z 

Example 15.8. If v = (1, 0, 3) and w = (5, —3, 12) are vectors in Euclidean 
3 space, then for any numbers A and B, 

u = Av + Bw = A(l, 0, 3) + B(5, -3, 12) = (A + 5B, -3B, 3A + 12B) 

(15.42) 

is a linear combination of v and w. □ 



The closure property of vector spaces is sometimes stated as following: Any 
linear combination of vectors is an element of the same vector 
space. For example, we can create linear combinations of functions and 
we know that they are also in the same vector space. 

Example 15.9. Let f(t) = 3sint, g(t) = t 2 — At be functions in the vector 
space V of real valued functions. Then if A and B are any real numbers, 

h(t) = A f{t) + Bg(t) (15.43) 
= Asint + B{t 2 -At) (15.44) 

is a linear combination of the functions / and g. Since V is a vector space, 
h is also in V. □ 

Example 15.10. Let V be the vector space consisting of real functions on 
the real numbers. Then differentiation, defined by 

D(V) = « (15.45) 

is a linear operator. To see that both properties hold let y(t) and z{t) be 
functions (e.g., y, z € V) and let c be a constant. Then 

D(v+z) = m^ = m + m =Diy)+D{z) (15 . 46) 
D(cy) = d M*i =c m =cD(y) (15 .47> 

Hence I? is a linear operator. □ 
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Definition 15.5. Two vectors y, z are called linearly dependent if there 
exists nonzero constants A, B such that 



If no such A and B exist, then we say that y and z arc Linearly Inde- 
pendent. 

In Euclidean 3D space, linearly dependent vectors are parallel, and lin- 
early independent vectors can be extended into lines that will eventually 
intersect. 

Since we can define a vector space of functions, the following also definition 
makes sense. 

Definition 15.6. We say that two functions / and g are linearly depen- 
dent if there exist some nonzero constants such that 



Ay + Bz = Q 



(15.48) 



Af(t) + Bg(t) = 0 



(15.49) 



for all values of t. If no such constants exists then we say that / and g 
are linearly independent. 
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Lesson 16 



Linear Equations With 
Constant Coefficients 



Definition 16.1. The general second order linear equation with con- 
stant coefficients is 

ay" + by' + cy = f(t) (16.1) 

where a, b, and c are constants, and a / 0 (otherwise (16.1) reduces to 
a linear first order equation, which we have already covered), and f(t) 
depends only on t and not on y. 

Definition 16.2. The Linear Differential Operator corresponding to 
equation (16.1) 

L = aD 2 + bD + c (16.2) 

where 

D= d - & ndD 2 = ^ (16.3) 
dt dt 2 K ' 

is the same operator we introduced in example (15.10). We can also write 
L as 

L -4> +b i +a < 16 - 4 > 

In terms of the operator L, equation (16.1) becomes 

Ly = f(t) (16.5) 
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Example 16.1. Show that L is a linear operator. 

Recall from definition (15.3) we need to show the following to demonstrate 
that L is linear 

L(ay + (3z) = aLy + f3Lz (16.6) 

where a and /3 are constants and y(t) and z(t) are functions. But 

L(ay + fiz) = {aD 2 + bD + c)(ay + f3z) (16.7) 

= aD 2 (ay + (3z) + bD(ay + 0z) + c(ay + /3z) (16.8) 

= a(ay + (iz)" + b(ay + (3z)' + c(ay + /3z) (16.9) 

= a{ay" + fiz") + b{ay' + (3z') + c(ay + /3z) (16.10) 

= a{ay" + by' + cy) + P(az" + bz' + cz) (16.11) 

^aLy + fiLz □ (16.12) 

Definition 16.3. The characteristic polynomial corresponding to char- 
acteristic polynomial (16.1) is 

ar 2 +br + c = 0 (16.13) 

Equation (16.13) is also called the characteristic equation of the differ- 
ential equation. 

The following example illustrates why the characteristic equation is useful. 

Example 16.2. For what values of r does y = e rt satisfy the differential 
equation 

y" - Ay' + 3y = 0 (16.14) 

Differentiating y — e rt , 

y' = re rt (16.15) 
y" = r 2 e rt (16.16) 

Plugging both expressions into (16.14), 

rV - 4re r * + 3e r t = 0 (16.17) 

Since e rt can never equal zero we can cancel it out of every term, 

r 2 -4r + 3 = 0 (16.18) 

Equation (16.18) is the characteristic equation of (16.14). Factoring it, 

(r-3)(r-l) = 0 (16.19) 
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Hence both r = 1 and r = 3. This tells us each of the following functions 
are solutions of (16.14): 

y = e* (16.20) 

y = e 3t (16.21) 

We will see shortly how to combine these to get a more general solution. □ 
We can generalize the last example as follows. 

Theorem 16.4. If r is a root of the characteristic equation of Ly = 0, 
then e rt is a solution of Ly = 0. 

Proof. 

L[e rt ] = a{e rt )" + b{e rt )' + c(e rt ) (16.22) 

= ar 2 e rt + bre rt + ce rt (16.23) 

= {ar 2 + br + c)e rt (16.24) 

Since r is a root of the characteristic equation, 

ar 2 +br + c = 0 (16.25) 

Hence 

L[e rt ] = 0 (16.26) 

Thus y = e rt is a solution of Ly = 0. □ 

Theorem 16.5. If the characteristic polynomial has a repeated root r, 
then y = te rt is a solution of Ly = 0. 

Proof. 

L(te rt ) = a(te rt )" + b(te rt )' + c(te rt ) (16.27) 

= a(e rt + rte rt )' + b(e rt + rte rt ) + cte rt (16.28) 

= a(2re rt + r 2 te rt ) + b(e rt + rte rt ) + cte rt (16.29) 

= e rt (2ar + b+(ar 2 + br + c)t) (16.30) 

Since r is a root, r 2 + br + c = 0. Hence 

L(te rt ) =e rt (2ar + b) (16.31) 

Since r is root, from the quadratic equation, 



-b ± \Jb 2 - 4ac 
2a 



(16.32) 
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When a root is repeated, the square root is zero, hence 

r = -l (16.33) 

Rearranging gives 

2ar + b = 0 (16.34) 

whenever r is a repeated root. Substituting equation (16.34) into equation 
(16.31) gives L{te rt ) = 0. □ 

Example 16.3. We can use theorem (16.4) to find two solutions of the 
homogeneous linear differential equation 

y" - 7y' + 12y = 0 (16.35) 

The characteristic equation is 

r 2 -7r + 12 = 0 (16.36) 

Factoring gives 

(r-3)(r-4) =0 (16.37) 

Since the roots are r — 3 and r = 4, two solutions of the differential equation 
(16.35) are 

ym = e 3t (16.38) 
VH2 = e 4t (16.39) 

Thus for any real numbers A and B, 

y = Ae 3t + Be 4 ' (16.40) 

is also a solution. □ 

Because equation (16.14) involves a second-order derivative the solution 
will in general include two constants of integration rather than the single 
arbitrary constant that we had when we were solving first order equations. 
These initial conditions are expressed as the values of both the function 
and its derivative at the same point, e.g., 



y(t 0 ) = yo 
y'(t 0 ) = 2/1 



(16.41) 
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The second order linear initial value problem is then 

(16.42) 



Ly 


= 0 


y(to) 


= yo 


y'(t 0 ) 


= y\ 



This is not the only way to express the constraints upon the solution. It 
is also possible to have boundary conditions, of which several types are 
possible: 

y(ta) — Vo,y(ti) = Vx (Dirichlet Boundary Conditions) (16.43) 

y(to) = 2/o> y'{t\) = Vi (Mixed Boundary Condition) (16.44) 

y'(to) — yo, y'(ti) = yi (Neumann Boundary Conditions) (16.45) 

Differential equations combined with boundary conditions are called Bound- 
ary Value Problems. Boundary Value Problems are considerably more 
complex than Initial Value Problems and we will not study them in this 
class. 

Definition 16.6. The homogeneous linear second order differential 
equation with constant coefficients is written as 

ay" + by' + cy = 0 (16.46) 

or 

Ly = 0 (16.47) 

We will denote a solution to the homogeneous equations as yu (£) to distin- 
guish it from a solution of 

ay" + by' + cy = f(t) (16.48) 

If there are multiple solutions to the homogeneous equation we will num- 
ber them yni,yH2, ■■■■ We will call any solution of (16.48) a particular 
solution and denote it as yp{t). If there are multiple particular solutions 
we will also number them if we need to. 

Theorem 16.7. If yn(t) is a solution to 

ay" + by' + cy = 0 (16.49) 

and yp{t) is a solution to 

ay" + by' + cy = f(t) (16.50) 

then 

y = y H (t) + y P (t) (16.51) 

is also a solution to (16.50). 
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Proof. We are give Lyn — 0 and Lyp = f(t). Hence 

Ly = L(y H + y P ) = Ly H + Ly P = 0 + f(t) = f(t) (16.52) 
Hence y — hn + yp is a solution. □ 



General Principal. The 


general solution to 




Ly 


= ay" + by 1 + cy = f(t) 


(16.53) 


is the sum of a homogeneous and a particular part: 






V = VH{t) + yp{t) 


(16.54) 


where Lyn = 0 and Lyp = 


fit)- 





Theorem 16.8. Principle of Superposition If yHi(t) and yH2{t) are 
both solutions of Ly = 0, then any linear combination 

y H {t) = Ay H1 {t) + By H2 {t) (16.55) 

is also a solution ofLy = 0. 

Proof. Since ym{t) and yH2(t) are solutions, 

Lym = 0 = Ly H2 (16.56) 

Since L is a linear operator, 

Ly H = L[Ay Hl +By H2 ] (16.57) 
= ALy m + BLy H2 (16.58) 
= 0 (16.59) 

Hence any linear combination of solutions to the homogeneous equation is 
also a solution of the homogeneous equation. □ 

General Solution of the Homogeneous Equation with Constant 
Coefficients. From theorem (16.4) we know that e rt is a solution of Ly = 0 
whenever r is a root of the characteristic equation. If r is a repeated root, 
we also know from theorem (16.5) that te rt is also a solution. Thus we 
can always find two solutions to the homogeneous equation with constant 
coefficients by finding the roots of the characteristic equation. In general 
these are sufficient to specify the complete solution. 
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The general solution to 

ay" + by' + cy = 0 (16.60) 



is given by 



, Ae rit + Be r2t n ^ r 2 (distinct roots) 
y = \ (16.61) 
(A + Bt)e r = r\ = T2 (repeated root) 



where r\ and r 2 are roots of the characteristic equation ar + br + c = 0 



Example 16.4. Solve the initial value problem 

y" -6y' + 8y = 0} 

y(0) = 1 I (16.62) 
1/(0) = 1 J 

The characteristic equation is 

0 = r 2 - 6r + 8 = (r - 4)(r- 2) (16.63) 
The roots are r = 2 and r = 4, hence 

y = Ae 2 * + Be At (16.64) 
From the first initial condition, 

l = A + B (16.65) 

Differentiating (16.64) 

y = 2Ae 2t + ABe 4t (16.66) 
From the second initial condition 

1 = 2,4 + 45 (16.67) 

From (16.65), B = 1 — A, hence 

3 

1 = 2A + 4(1 - A) = 4 - 2A =>■ 2A = 3 A = - (16.68) 

hence 

B = l-A = l-~=-^ (16.69) 



The solution to the IVP is 

a = 

2 2 



vA^-V 1 □ (16-70) 
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Example 16.5. Solve the initial value problem 

(16.71) 



y" - 6y' + 9y = 0 ' 
2/(0) = 4 
1/(0) = 17. 



The characteristic equation is 

0 = r 2 - 6r + 9 = (r - 3) 2 (16.72) 

Since there is a repeated root r = 3, the general solution of the homogeneous 
equation is 

y = Ae 3t + Bte 3t (16.73) 
By the first initial condition, we have 4 = y(0) = A. Hence 

y = 4e 3 * + Bte 3t (16.74) 

Differentiating, 

y' = 12e 3t + Be et + 3Bte 3t (16.75) 
From the second initial condition, 

17 = ?/(0) = 12 + B + 3B = 12 + B =+> B = h (16.76) 

Hence the solution of the initial value problem is 

y=(A + ht)e 3t . □ (16.77) 



Lesson 17 



Some Special 
Substitutions 



Equations with no y dependence. 

If c = 0 in L then the differential equation 

Ly = f(t) (17.1) 

simplifies to 

ay" + by' = f(t) (17.2) 

In this case it is possible to solve the equation by making the change of 
variables z = y', which reduces the ODE to a first order linear equation 
in z. This works even when a or b have t dependence. This method is 
illustrated in the following example. 

Example 17.1. Find the general solution of the homogeneous linear equa- 
tion 

y " + 6y' = 0 (17.3) 
Making the substitution z = y' in (17.3) gives us 

z' + 6z = 0 (17.4) 

Separating variables and integrating gives 



dz 

z 



6dt =^ z = Ce~ M (17.5) 
143 
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Replacing z with its original value of z = y', 

Ce~ 6t (17.6) 



dt 



Hence 



I* <>"> 

Ce _6 'di = (17.8) 

= -^Ce- 6t + C" (17.9) 
6 

Since — C/6 is still a constant we can rename it C" = — C/6, then rename 
C" back to C, giving us 

y = Ce- 6t + C" □ (17.10) 

Example 17.2. Find the general solution o 

y" + Gy' = t (17.11) 

We already have solved the homogeneous problem y" + 6y' — 0 in example 
(17.1). From that we expect that 

y = Y P + Y H (17.12) 

where 

Y H = Ce- 6t + C (17.13) 

To see what we get if we substitute z = y' into (17.11) and obtain the first 
order linear equation 

z' + 6z = t (17.14) 
An integrating factor is fi = exp (J6dt) = e 6t , so that 

j t (ze 6t ) = {zf + 6t) e 6t = te 6t (17.15) 



Integrating, 



— (ze 6t ) dt = J te m dt (17.16) 

ze 6t = — (6t- l)e 6t + C (17.17) 
36 

z = L-^- + Ce- 6t (17.18) 
6 36 
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Therefore since z = y' , 



Integrating gives 



^rZ-y-l 0 ^'* 0 ' (17 - 20) 

It is customary to combine the (— 1/6)C into a single unknown constant, 
which we again name C, 

y = h t2 ~h t+Ce ~ 6t+c ' (17 - 21) 

Comparing this with (17.12) and (17.13) we see that a particular solution 
is 

y P = —t 2 □ (17.22) 

y 12 36 y ' 

This method also works when b(t) has t dependence. 

Example 17.3. Solve 

y"+2ty'=f 

2/(0) - 1 \ (17.23) 
1/(0) = 0, 

Substituting z = y' gives 

z' + 2tz = t (17.24) 
An integrating factor is exp (/ 2tdt) = e* . Hence 

lKH«" < 17 - 25 > 

ze* 2 = J te t2 dt + C= \ e + C (17.26) 

z = - + Ce"* 2 (17.27) 
From the initial condition y'(0) = z(0) = 0, C = —1/2, hence 

dy 1 1 + 2 

-r = « - ~ e (17.28) 

dt 2 2 y ' 

Changing the variable from t to s and integrating from t = 0 to t gives 



ds= -ds- e~ s ds (17.29) 
o ds J 0 2 2 J 0 
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From (4.91), 

f e - s2 ds = ^erf(t) (17.30) 
Jo 2 

hence 

y(t)-y(0)= t --^etf(t) (17.31) 
From the initial condition y(O) = 1, 

y(t) = l + |-^erf(t) □ (17.32) 

] This method also works for nonlinear equations. 
Example 17.4. Solve y" + t(y') 2 = 0 

Let z = y' , then z' = y" , hence z' + tz 2 = 0. Separating variables, 

I = < 17 - 33 > 

z" 2 dz = -tdt (17.34) 

\+Ci = -\t 2 (17.35) 

Solving for z, 

dy _ _ -1 _ -2 ri7^ 

<ft i 2 /2 + d ~ < 2 + C 2 1 j 



where = 2Ci hence 



y = -2arctan| + C (17.37) 



where k — \J~C~2 and C are arbitrary constants of integration. □ 



Equations with no t dependence 

If there is no i-dependence in a linear ODE we have 

Ly = ay" + by' + cy = 0 (17.38) 

This is a homogeneous differential equation with constant coefficients and 
reduces to a case already solved. 

If the equation is nonlinear we can make the same substitution 
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Example 17.5. Solve yy" + (j/) 2 = 0. 

Making the substitution z — y' and y" = z' gives 

zz' + z 2 = 0 (17.39) 

We can factor out a z, 

z(z' + z) = 0 (17.40) 
hence either z = 0 or z' = —z. The first choice gives 

f t = 0 => yi = C (17.41) 

as a possible solution. The second choice gives 

— = -dt => lnz = -t + fc => z = Ke~ l (17.42) 

where if = eT k is a constant. Hence 

— = Kb-* => dy = Ke^dt (17.43) 
at 

y = -Ke- 1 + Kx (17.44) 

where K i is a second constant of integration. If we let Kq = —K then this 
solution becomes 

y 2 = K 0 e- t + K 1 (17.45) 

Since we cannot distinguish between the two arbitrary constants K\ in the 
second solution and C in the first, we see that the first solution is actually 
found as part of the second solution. Hence (17.45) gives the most general 
solution. □ 



Factoring a Linear ODE 

The D operator introduced in example (15.10) will be quite useful in study- 
ing higher order linear differential equations. We will usually write it as a 
symbol to the left of a function, as in 

Dy=f t (17.46) 

where D is interpreted as an operator, i.e., D does something to whatever 
is written to the right of it. The proper analogy is like a matrix: think of 
D as an n x n matrix and y as a column vector of length n (or an n x 1 
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matrix). Then we are allowed to multiply D by y on the right, to gives us 
another function. Like the matrix an vector, we are not allowed to reverse 
the order of the D and whatever it operates on. Some authors write D[y], 
D(y), D t y, or d t y instead of Dy. 

Before we begin our study of higher order equations, we will look at what 
the D operator represents in terms of linear first order equations. While 
it doesn't really add anything to our understanding of linear first order 
equations, looking at how it can be used to describe these equations will 
help us to understand its use in higher order linear equations. 

We begin by rewriting the first order linear differential equation 

^+p(t)y = q(t) (17.47) 

as 

Dy+p(t)y = q(t) (17.48) 

The trick here is to think like matrix multiplication: we are still allowed 
the distributive law, so we can factor out the y on the left hand side, but 
only on the right. In other words, we can say that 

[D+p(t)]y = q(t) (17.49) 

Note that we cannot factor out the y on the left, because 

Dy ^ yD (17.50) 

so it would be incorrect to say anything like 

y(D+p(t)) = q(t) (17.51) 

In fact, anytime you see a D that is not multiplying something on its right, 
that should ring a bell telling you that something is wrong and you have 
made a calculation error some place. 

Continuing with equation 17.49 we can now reformulate the general initial 
value problem as 

[D+p(t)}y = q(t)) 

v(to) = yo J 



(17.52) 



The D operator has some useful properites. In fact, thinking in terms of 
matrices, it would be nice if we could find an expression for the inverse of 
D so that we could solve for y. If M is a matrix then its inverse M" 1 has 
the property that 

MM^ 1 = M~ X M = I (17.53) 
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where / is the identity matrix. 

Since the inverse of the derivative is the integral, then for any function f(t), 

D-\f(t) = Jf(t)dt + C (17.54) 

DD-\f(t) = D f(t) +C^j= f(t) (17.55) 



Hence 



and 



D^Dfit) = J Df(t)dt + C = f(t) + C (17.56) 

We write the general linear first order initial value problem in terms of the 
linear differential operator D = d/dt as 



[D+p(t)]y = q(t),y(t 0 )=yo (17.57) 
From the basic properties of derivatives, 

De fw = ± e m = e fw d f{t) = e f(t) Df{t) (17 58) 

(XL (XL 

From the product rule, 

Df(t)g{g) = f(t)Dg(t) + g(t)Df(t) (17.59) 

Hence 

D{e f{t) y) = e fm Dy + yDe f(t) (17.60) 

= e f ^Dy + ye nt) Df(t) (17.61) 

= e'W (Dy + yDf(t)) (17.62) 

If we let 

f(t) = J p(t)dt = D^p^dt (17.63) 
then (using our previous definition of /i), 

e f{t) = cxp (^J p(t)d?j = n(t) (17.64) 
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hence 



D{e f ^y) 


= e f(t) (Dy 


+ yDD- 1 p(t)) 


(17.65) 




= eJ {t) {Dy 


+ W>(*)) 


(17.66) 




= e«')(flj 


-p(t))v 


(17.67) 




= fi(t)(D + 


p(t))y 


(17.68) 




= /*(*)?(*) 




(17.69) 



Applying D 1 to both sides, 

D^Di^y) = D- l {^{t)q{t)) (17.70) 

The -D -1 and D are only allowed to annihilate one another if we add a 
constant of integration (equation 17.56) 

li(t)y = D- l {ii{t)q(t)) + C (17.71) 

or 

y = -(D- 1 l iq + C) (17.72) 
A* 

which is the same result we had before (see equation 4.18): 

y = W) (/m*M*)* + c) ( 17 - 73 ) 

This formalism hasn't really given us anything new for a general linear 

equation yet. When the function p is a constant, however, it does give us 
a useful way to look at things. 

Suppose that 

p(t) = A (17.74) 
where A is an constant. Then the differential equation is 

(D + A)y = q(t) (17.75) 

This will become useful when we solve higher order linear equations with 
constant coefficients because they can be factored: 

(D + A)(D + B)y = D 2 y + (A + B)Dy + ABy (17.76) 

Thus any equation of the form 

y" + ay' + by = q{t) (17.77) 
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can be rewritten by solving 

a = A + B (17.78) 
b = AB (17.79) 

for A and B. Then the second order equation is reduced to a sequence of 
first order equations 

(D + A)z = q(t) (17.80) 
(D + B)y = z(t) (17.81) 

One first solves the first equation for z then plugs the solution into the 
second equation to solve for y. 
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Lesson 18 



Complex Roots 



Wc know form algebra that the roots of the characteristic equation 

ar 2 +br + c = 0 (18.1) 
are given by the quadratic formula 

2a y ' 

When 

b 2 < Aac (18.3) 
the number in the square root will be negative and the roots will be complex. 
Definition 18.1. A complex number is a number 

z = a + bi (18.4) 
where a, b are real numbers (possibly zero) and 

i = ^TA (18.5) 

To find the square root of a negative number we factor out the —1 and use 
i = -v/— T, and use the result that 



= y/{-l)(a) = = i^a (18.6) 

Example 18.1. Find 7^9. 

7^9 = v / (-l)(9) = V^lV9 = 3i □ (18.7) 
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Example 18.2. Find the roots of 

r 2 +r + l = 0 (18 
We have a = b = c = 1 hence according to (18.2) the roots are 
_ -1±V1 2 -(4)(1)(1) -1±V=3 



2(1) 2 ( 18J ) 

Since —3 < 0 it does not have a real square root; 

= v / (3)(-l) = \/ z l\ / 3 = iVs (18.10) 

hence _ 

-l±n/3 1..V3 ( . 

r = 7. = — ~ ± l ^r~ (18.11) 

2 2 2 v ; 

Properties of Complex Numbers 

1. li z = a + ib, where a, b £ M, then we say that a is the real part of 
z and b is the imaginary part, and we write 



Re(z) = Re(a + ib) = a 
lm(z) = Im(a + ib) = b 



(18.12) 



2. The absolute value of z = x + iy is the distance in the xy plane 
from the origin to the point (x,y). Hence 



\x + iy\ = y / x 2 +y 2 (18.13) 

3. The complex conjugate of z — x + iy is a complex number with all 
of the i's replaced by — i, and is denoted by z, 



z = x + iy z = x + iy = x — iy (18.14) 

4. If z = x + iy is any complex number then 

\z\ 2 = zz (18.15) 

because 

x 2 + y 2 = {x + iy){x - iy) (18.16) 

5. The phase of a complex number z = x + iy, denoted by Phase(z) is 
the angle between the x — axis and the line from the origin to the 
point (x, y) 

Phase(z) = arctan — (18.17) 

x 
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Theorem 18.2. Euler's Formula 

e 10 = cos 9 + i sin 9 

Proof. Use the fact that 



(18.18) 



^ 4 = = = 1 

i b = {(i 4 ) = i 



( ,4 fe+ l = • 

2 4fe + 3 = -i 
l Ak+i = 1 



in the formula's for a Taylor Series of e 10 : 



> for all fc = 0,1,2,... 

(18.19) 



ie „ (i9f aef {i9f uef 
e 10 = 1 + {i0) + ^f - + ^f - + ^f- + ^f- + ■ 



2! 



3! 



4! 



5! 



„-4fl4 



5/D5 



= 1 + i0 + 



4! 



2! 3! 

1 + ^ - 777 + -^777 + — + 1 



i b 9 



+ 



2! 3! 4! 
even powers of 0 



5! 



2! + 4! 



= cos 9 + i sin ( 



06 
6! 



+i 



e 3 e 5 9 7 

3\ + 5\ ~ 7T 



odd powers of 0 



(18.20) 
(18.21) 
(18.22) 

(18.23) 
(18.24) 



where the last step follows because we have used the Taylor series for sin 9 
and cos 9. □ 

Theorem 18.3. If z = a + ib where a and b are real numbers than 

e z = e a+ib = e a (cos 0 + i sm6) (18.25) 

Theorem 18.4. If z = x + iy where x, y are real, then 

z = r(cos9 + ism9)=re 10 (18.26) 

where 9 = Phase(z) and r = \z\. 



Proof. By definition 9 = Phase(.z) is the angle between the x axis and the 



156 



LESSON 18. COMPLEX ROOTS 



line from the origin to the point (x,y). Hence 

x 

V* 2 + V 2 ~ \* 

y_ 

\A 2 + y' 2 



smO = V = ^- (18.28) 



z = x + iy (18.29) 
X ■ i±) (18.30) 



Therefore 



>l \z\ 

= |z|(cos(9 + isin6l) (18.31) 

= \z\e ze (18.32) 

This form is called the polar form of the complex number. □ 

Roots of Polynomials 

1. If z = x + iy is the root of a polynomial, then z = x — iy is also a 
root. 

2. Every polynomial of order n has precisely n complex roots. 

3. Every odd-ordered polynomial of order n has at least one real root: 
the number of real roots is either 1, or 3, or 5, or n; the remaining 
roots are complex conjugate pairs. 

4. An even-ordered polynomial of order n has cither zero, or 2, or 4, 
or 6, or ... n real real roots; all of the remaining roots are complex 
conjugate pairs. 

Theorem 18.5. Every complex number z has precisely n unique n th roots. 

Proof. Write z in polar form. 

z = re 10 = re l9+2k7r = re*V fc7r , k = 0, 1, 2, . . . (18.33) 
where r and 9 are real numbers. Take the n th root: 

tfz = (18.34) 
= (re ie+2k ") 1/n (18.35) 

= r l/n e i(e+2kn)/n (18.36) 

= tfr cos +isin (18.37) 
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For k = 0, 1, 2, . . . , n — 1 the right hand side produces unique results. But 
for k > n, the results start to repeat: k — n gives the same angle as k = 0; 

k = n + 1 gives the same angle as k = 1; and so on. Hence there are 

precisely n unique numbers. □ 

Example 18.3. Find the three cube roots of 27. 
To find the cube roots we repeat the proof! 

27 = 27 + (0)i = 27eWW = 27e w(0+27r) = 27e 2km (18.38) 

^27 = 27 1/3 (e 2 '"™) 1/3 (18.39) 

= 3e 2fe7H/3 (18.40) 

For fe = 0 this gives 

^27 = 3 (18.41) 

For fc = 1 this gives 

^27 = 3e 2 -/3 = 3 ( cos ^ + zsin ^ = _3 + .3>/3 (lg 42) 

For k = 2 this gives 

^27 = 3e 4 -/ 3 = 3 (cos f + ism = - | - (18.43) 

Using fc = 3 will give us the first result, and so forth, so these are all the 

possible answers. □ 

Theorem 18.6. If the roots of 

ar 2 + br + c = 0 (18.44) 

are a complex conjugate pair 



ri = fi + iuj 
T2= jJ.- iu 



(18.45) 



where fi, to e R and w^O, (this will occur when b 2 < 4ac), then the solution 
of the homogeneous second order linear ordinary differential equation with 
constant coefficients 

Ly = ay" + by' + cy = 0 (18.46) 

is given by 

VH = C ie rit + C 2 e r2t (18.47) 
= (A cos ut + B smut) (18.48) 
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where 

A = d + C 2 (18.49) 

B = i(d - C 2 ) (18.50) 

Proof. 

y H = de rit + de r2t (18.51) 

= de [p+luj)t + de { ^ lu)t (18.52) 

= e^(de iojt + de~ iujt ) (18.53) 

= e M * [Ci (cos ojt + i sin u>t) + C 2 (cos u>t - i sin cot)] (18.54) 

= [(d + d) cosojt + i(d - d) sinwt] (18.55) 

= (A cos cut + 5 sin ut) (18.56) 

□ 

Example 18.4. Find the general solution of 

y" + 6y' + 25y = 0 (18.57) 
The characteristic polynomial is 

r 2 + 6r + 25 = 0 (18.58) 

and the roots are 

-6± 7=64 -6±8i n , A 

r= ^ = __ = -3±4z (18.59) 

Hence the general solution is 

y = e~ 3t A cos 4i + Bsin At]. (18.60) 

for any numbers A and B. □ 

Example 18.5. Solve the initial value problem 

y" + 2y' + 2y = 0 > | 

1/(0) = 2 I (18.61) 
y' (0) ^ 4 J 

The characteristic equation is 

r 2 + 2j/ + 2 = 0 (18.62) 
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and its roots are given by 

r = - 2± ^ (2) 2 2 - 4(1)(2) = ^ = -1 ± i (18.63) 
The solution is then 

y = e~ t (Acost + Bsint) (18.64) 
The first initial condition gives 

2 = A (18.65) 

and thus the solution becomes 

?/ = e"' (2 cost + .Bsint) (18.66) 
Differentiating this solution 

y = -e"*(2 cost + B sin t) + e~ t (-2sint + B cost) (18.67) 
The second initial condition gives us 

4= -2 + B => B = 6 (18.68) 

Hence 

y = e _t (2cost-6sini) (18.69) 

□ 

Summary. General solution to the homogeneous linear equation with 
constant coefficients. 



The general solution to 

ay" + by' + cy = 0 (18.70) 

is given by 

!Ae Tlt + Be T2t r\ ^ (distinct real roots) 

(A + Bt)e rt r = n = r 2 (repeated real root) (18.71) 

e^* (A cos ujt + B sin ait) r = /j,±iu (complex roots) 

where n and r-i are roots of the characteristic equation ar 2 + br + c = 0. 



160 



LESSON 18. COMPLEX ROOTS 



Why Do Complex Numbers Work?* 

We have not just pulled i = \/— 1 out of a hat by magic; we can actually 
define the Field of real numbers rigorously using the following definition. 

Definition 18.7. Let a, b E R. Then a Complex Number is an ordered 
pair 

z=(a,b) (18.72) 

with the following properties: 

1. Complex Addition, defined by 

z + w = (a + c,b + d) (18.73) 

2. Complex Multiplication, defined by 

z x w = (ac- bd,ad + bc) (18.74) 

where z = (a, b) and w = (c, d) are complex numbers. 

Then we can define the real and imaginary parts of z as the components 
Rez = Re(a, b) = a and Imz = Im(a, b) = b. 

The Real Axis is defined as the set 

{z = {x,Q)\x G R} (18.75) 
and the imaginary axis is the set of complex numbers 

{z=(0,y)\yeR} (18.76) 

We can see that there is a one-to-relationship between the real numbers 
and the set of complex numbers (x, 0) that we have associated with the 
real axis, and there is also a one-to-one relationship between the set of all 
complex numbers and the real plane M 2 . We sometimes refer to this plane 
as the complex plane or C. 

To see that equations 18.73 and 18.74 give us the type of arithmetic that we 
expect from imaginary numbers, suppose that a, b, c G R and define scalar 
multiplication by 

c{a,b) = (ca,cb) (18.77) 
To see that this works, let u = (x, 0) be any point on the real axis. Then 



uz — (x, 0) x (a, b) = (ax — 06, bx — 0a) = (ax, bx) = x(a, b) (18.78) 
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The motivation for equation 18.74 is the following. Suppose z — (0,1). 
Then by 18.74, 

z 2 = (0, 1) x (0, 1) = (-1,0) (18.79) 

We use the special symbol i to represent the complex number i = (0, 1). 
Then we can write any complex number z = (a, b) as 

z = (a, b) = (a, 0) + (6, 0) = a(l, 0) + 6(0, 1) (18.80) 

Since i = (0,1) multiplication by (1,0) is identical to multiplication by 1 
we have 

z = (a,b)=a + bi (18.81) 

and hence from 18.79 

i 2 = -1 (18.82) 

The common notation is to represent complex numbers as z = a + bi where 
a, b G R, where i represents the square root of —1. It can easily be shown 
that the set of complex numbers defined in this way have all of the properties 
of a Field. 

Theorem 18.8. Properties of Complex Numbers 

1. Closure. The set of complex numbers is closed under addition and 
multiplication. 



2. Commutivity. For all complex number w, z, 



w + z = z + w 
wz — zw 



3. Associativity. For all complex numbers u, v, w, 

(u + v) + w = u + (v + w) 
(uv)w = u(vw) 

4. Identities. For all complex numbers z, 

z+Q=Q+z=z 
zl = lz = z 



(18.83) 



(18.84) 



(18.85) 



5. Additive Inverse. For every complex number z, there exists some 
unique complex number w such that z + w = 0. We call w = —z and 

z + (-z) = (-z)+z = 0 (18.86) 
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6. Multiplicative Inverse. For every nonzero complex number z, there 
exists some unique complex number w such that zw — wz = 1. We 
write w = 1/z, and 

z{z' v ) = {z- x )z = 1 or z(l/z) = (l/z)z = 1 (18.87) 



7. Distributivity. For all complex numbers u, w, z, 

u(w + z) = uw + uz 



(18.88) 



Lesson 19 



Method of Undetermined 
Coefficients 



We showed in theorem (22.7) that a particular solution for 

ay" + by' + cy = f(t) (19.1) 

is given by 

J f(t)e- rit d?j dt (19.2) 

where t\ and are roots of the characteristic equation. While this for- 
mula will work for any function f(t) it is difficult to memorize and there 
is sometimes an easier to find a particular solution. In the method of 
undetermined coefficients we do this: 

1. Make an educated guess on the form of yp{t) up to some unknown 
constant multiple, based on the form of f{t). 

2. Plug y P into (19.1). 

3. Solve for unknown coefficients. 

4. If there is a solution then you have made a good guess, and are done. 

The method is illustrated in the following example. 
Example 19.1. Find a solution to 

y" - y = t 2 (19.3) 



yp 



—e 
a 



rot 



3 (ri— r 2 )4 
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Since the characteristic equation is r 2 — 1 = 0, with roots r = ±1, we know 
that the homogeneous solution is 

Vh = Cte* + C 2 e~ t (19.4) 

As a guess to the particular solution we try 

ijp = At 2 + Bt + C (19.5) 



Differentiating, 



Substituting into (19.1) 



y' P = 2At + B (19.6) 
Vp = 2A (19.7) 



2A- At 2 - Bt-C = t 2 (19.8) 



Since each side of the equation contains polynomials, we can equate the 
coefficients of the power on each side of the equation. Thus 

Coefficients of t 2 : -A = l (19.9) 
Coefficients of t : B = 0 (19.10) 
Coefficients of t° : 2A - C = 0 (19.11) 

The first of these gives A = —1, the third C = 2A = —2. Hence 

y P = -t 2 -2 (19.12) 

Substitution into (19.1) verifies that this is, in fact, a particular solution. 
The complete solution is then 

V = Vh + yp = C x e T + C 2 e- t - t 2 - 2 □ (19.13) 

Use of this method depends on being able to come up with a good guess. 
Fortunately, in the case where / is a combination of polynomials, exponen- 
tials, sines and cosines, a good guess is given by the following heuristic. 

1. If f(t) is a polynomial of degree n, use 

y P = a n t n + a n ^t n - 1 -\ a 2 t 2 + ait + a 0 (19.14) 

2. If /(t) = e rt and r is not a root of the characteristic equation, try 

y P = Ae rt (19.15) 
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3. If f(t) — e rt and r is a root of the characteristic equation, but is not 
a repeated root, try 

y P = Ate rt (19.16) 

4. If f(t) — e rt and r is a repeated root of the characteristic equation, 
try 

y P = At 2 e rt (19.17) 

5. If f(t) = asincot + f3 cos ujt, where a,/3,ui € K, and neither sinwi nor 
cos urt are solutions of the homogeneous equation, try 

y P = Acosujt + Bsinut (19.18) 

If (19.18) is a solution of the homogeneous equation, instead try 

y P = t(Acosut + Bsinujt) (19.19) 

6. If / is a product of polynomials, exponentials, and/or sines and 
cosines, use a product of polynomials, exponentials, and/or sines and 
cosines. If any of the terms in the product is a solution of the homo- 
geneous equation, multiply the entire solution by t or t 2 , whichever 
ensures that no terms in the guess are a solution of Ly = 0. 

Example 19.2. Solve 

y" + y'-6y = 2t (19.20) 
The characteristic equation is 

r 2 + r-6 = (r-2)(r + 3) = 0 (19.21) 

hence 

VH = C ie 2t + C 2 e~ 3t (19.22) 

Since the forcing function (right-hand side of the equation) is 2t we try a 
particular function of 

y P = At + B (19.23) 

Differentiating, 

VP = A (19.24) 
y" P = 0 (19.25) 

Substituting back into the differential equation, 

0 + A-6(At + B) =6f (19.26) 
-6At + A + B = 6t (19.27) 
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Equating like coefficients, 

-6A = 6 A = -1 (19.28) 

A + B = 0 B = -A = l (19.29) 

y p = -t + 1 (19.30) 

hence the general solution is 

y = C* ie 2 * + C 2 e- 3t - t + 1 □ (19.31) 
Example 19.3. Find the general solution to 

y" - 3y' -4y = e'* (19.32) 
The characteristic equation is 

r 2 - 3r -4 = (r-4)(r + 1) = 0 (19.33) 

so that 

to = C ie 4 * + C 2 e-« (19.34) 
From the form of the forcing function we are tempted to try 

yp = Ae' 1 (19.35) 
but that is already part of the homogeneous solution, so instead we try 

y P = Ate'* (19.36) 

Differentiating, 

y' = Ae-* - Ate'* (19.37) 

y" = -2Ae~* + Ate-* (19.38) 
Substituting into the differential equation, 

-2Ae~* + Ate-* - 3(Ae"* - Ate'*) - A{Ate~ t ) = e~* (19.39) 

-2A + At - 3(A - At) - A{At) = 1 (19.40) 

-2A + At - 3A + 3At -AAt = l (19.41) 

-5A = 1 (19.42) 



hence 



(19.43) 



yp = -he-* (19.44) 



and the general solution of the differential equation is 



y = de A * + C 2 e~* - \te~* □ (19.45) 
5 



Example 19.4. Solve 

y" + Ay = 3 sin 2^ 
y(0) = 0 I 

y'(0) = -i J 

The characteristic equation is 

r 2 +4 = 0 

So the roots are ±2i and the homogeneous solution is 

yn = C\ cos 2t + Ci sin 2t 
For a particular solution we use 
y = t(A cos 2t + 5sin2t) 

y' = Aa cos 2t + B sin 2t + t(2B cos 2t - 2A sin 2t) 
y" = AB cos 2t - AA sin 2t + t(-AA cos 2t - AB sin 2t) 

Plugging into the differential equation, 

AB cos 2t - AA sin 2t + t(—AA cos 2t - AB sin 2t) 
+ 4t(A cos 2t + B sin 2t) = 3 sin 2t 

Canceling like terms, 

AB cos 2t - AA sin 2t = 3 sin 2i 

equating coefficients of like trigonometric functions, A = 0, B 

3 

y = C\ cos 2i + C 2 sin 2i + -t sin 2i 

From the first initial condition, y(0) = 0, 

0 = Ci 

hence 

3 

y = C*2 sin 2i + -£ sin 2i 

Differentiating, 

3 3 
y' = 2C 2 cos 2t+ - sin 2i + -i cos 2t 
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The second initial condition is y'(0) = — 1 so that 

- 1 = 2C 2 (19.58) 

hence 

13 , 

y = --sin2i + -tsin2t □ (19.59) 

Example 19.5. Solve the initial value problem 



y"-y = t + e^ 



(19.60) 



1/(0) = 0 

y'(0) = i 

The characteristic equation is r 2 — 1 = 0 so that 

Vh = Cie* + C 2 e~ t (19.61) 

For a particular solution we try a linear combination of particular solutions 
for each of the two forcing functions, 

y P = At + B + Ce 2t (19.62) 
y' P = A + 2Ce 2t (19.63) 
y' P = 4Ce 2t (19.64) 

Substituting into the differential equation, 

4Ce 2t — At — B — Ce 2t = t + e 2t (19.65) 

3Ce 2t — At — B = t + e 2t (19.66) 

A = -1 (19.67) 

B = 0 (19.68) 

C= l - (19.69) 

Hence 

y = Cie* + C 2 e- 4 - t + ^e 2 * (19.70) 
From the first initial condition, y(0) = 0, 

0 = d + C 2 + \ (19.71) 
From the second initial condition y'(0) = 1, 

1 = d - C 2 + ? (19.72) 
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Adding the two equations gives us C\ — 0 and substitution back into either 
equation gives C 2 = —1/3. Hence 

y = -\e- t -t+ l -e 2t □ (19.73) 

Here are some typical guesses for the particular solution that will work for 
common types of forcing functions. 







1 AnCT oni 


A 


/ 


At -\- Ft 


at 2 + bt + c 


Ai 2 + Bt + C 




A f n A 4- An 


a cos cot 


A cos uot + B sin cot 


b sin cot 


A cos cot + B sin uit 


t cos uit 


(At + B) cos ut + (Ct + D) sin cot 


t sin 


(At + B) cos tot + (Ct + D) sin cot 


(a n t n + • • • + a 0 ) sinwt 


(A n t n H h A 0 ) coswi+ 

H h A 0 )sinwt 


(a„t" + • • • + ao) cos 


(A„f n + ---+A 0 )cosa;t+ 
(A„t™ H h A 0 )sinwt 




e a i 


ie at 


(At + B)e a t 


t sin u;ie at 


e a t((At + B) sinwi + (Ct + D) cos cot) 


(a„i n + • • • + a 0 )e a * 


(A n t n + ■■■+ A 0 )e at 


(a„t" + • • • + a 0 )e a * coscjt 


(A n t n H + A,)e a * coswi+ 

(A„i" H h A,)e a * sinwi 



If the particular solution shown is already part of the homogeneous solution 
you should multiply by factors of t until it no longer is a term in the 
homogeneous solution. 
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Lesson 20 



The Wronskian 



We have seen that the sum of any two solutions yi , y 2 to 

ay" + by' + cy = 0 (20.1) 

is also a solution, so a natural question becomes the following: how many 
different solutions do we need to find to be certain that we have a general 
solution? The answer is that every solution of (20.1) is a linear com- 
bination of two linear independent solutions. In other words, if y% 
and t/2 are linearly independent (see definition (15.6)), i.e, there is no 
possible combination of constants A and B, both nonzero, such that 

A Vl (t) + By 2 (t) = 0 (20.2) 

for all t, and if both y\ and y 2 are solutions, then every solution of (20.1) 
has the form 

V = C m (t) + C 2 y 2 (t) (20.3) 
We begin by considering the initial value problem 1 

y" +p(t)y' + q(t)y = 0 

y(t 0 ) = yo \ (20.4) 

y'(to) = y' 0 ) 

Suppose that y\ (t) and y 2 (t) are both solutions of the homogeneous equa- 
tion; then 

y(t) = A Vl {t) + By 2 {t) (20.5) 

Eq. (20.1) can be put in the same form as (20.4) so long as a 7^ 0, by setting 
p(t) = b/a and q(t) = c/a. However, (20.4) is considerably more general because we are 
not requiring the coefficients to be constants. 
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is also a solution of the homogeneous ODE for all values of A and B. To 
see if it is possible to find a set of solutions that satisfy the initial condition, 
(20.4) requires that 



y(t 0 ) = Ayi(t 0 ) + By 2 (t 0 ) = y 0 
y'(t 0 ) = Ay' 1 (t 0 )+By' 2 (t 0 )=y' 0 



(20.6) 
(20.7) 



If we multiply the first equation by y 2 (to) and the second equation by y 2 (to) 
we get 



A yi (t 0 )y' 2 (t 0 ) + By 2 {t 0 )y' 2 (t 0 ) = y 0 y' 2 (t 0 ) 
Ay' 1 (t 0 )y 2 (t 0 ) + By' 2 {t Q )y 2 {t Q ) = y' 0 y 2 (t 0 ) 



(20.8) 
(20.9) 



Since the second term in each equation is identical, it disappears when we 
subtract the second equation from the first: 



Ayi(t 0 )y 2 (t 0 ) - Ay[(t 0 )y 2 (t 0 ) = y 0 y 2 (t 0 ) - y^tto) 
Solving for A gives 



A = 



yoy 2 (t 0 ) - v'oV2{tg) 
yi(to)y' 2 (to) - y' 1 (t 0 )y 2 (to) 



(20.10) 



(20.11) 



To get an equation for B we instead multiply (20.6) by y[ (to) and (20.7) 
by yi (t 0 ) to give 

Ayx^y'^to) + By 2 (to)y[(to) = y 0 y[(to) (20.12) 
Ay[(t 0 )yi(t 0 ) + By 2 (t 0 )yi(t 0 ) = y' 0 yi(t 0 ) (20.13) 

Now the coefficients of A are identical, so when we subtract we get 

By^y^to) ~ By 2 (t 0 )yi(t 0 ) = y 0 iA(t 0 ) ~ y' 0 yi(t 0 ) (20.14) 

Solving for B, 

B = yf^\-y^) (2 o.i5) 

y2(to)y[(to) - y' 2 (to)yi(t 0 ) 1 ; 

If we define the Wronskian Determinant of any two functions y\ and y 2 
as 



W(t) 



yxit) y 2 (t) 
y'i(t) y'2(t) 



yi(t)y 2 (t) - y2(t)y[(t) 



then 



A = 



W(to) 



yo V2(t 0 ) 
y'o y^o) 



B = 



W(t 0 ) 



y% (to) yo 
yU*o) y'o 



(20.16) 



(20.17) 



Thus so long as the Wronskian is non-zero we can solve for A and 

B. 
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Definition 20.1. The Wronskian Determinant of two functions y\ and 
y 2 is given by 



W(t) 



yi(t) i/a(t) 
y'i(t) y' 2 (t) 



= yi(t)y' 2 (t) - y2(t)y' 1 (t) 



(20.18) 



If yi and y 2 are a fundamental set of solutions of a differential equation, 
then W(t) is called the Wronskian of the Differential Equation. 



Example 20.1. Find the Wronskian of y\ = smt and y 2 

W(yi,y 2 )(t) = yiy 2 - y 2 y[ 

= (smt)(x 2 )'~- (x 2 )(smt)' 
= 2x sin t — x 2 cos t □ 



(20.19) 
(20.20) 
(20.21) 



Example 20.2. Find the Wronskian of the differential equation y" —y = 0. 

The roots of the characteristic equation is r 2 — 1 = 0 are ±1, and a fun- 
damental pair of solutions are y\ = e* and y 2 — e~* . The Wronskian is 
therefore 



W(x) = 



= -2. □ 



(20.22) 



The discussion preceding Example (20.1) proved the following theorem. 

Theorem 20.2. Existence of Solutions. Let y\ and y 2 be any two 

solutions of the equation 



y" + p(t)y' + q(t)y = o 



such that 



W(t 0 ) - yi(t 0 )y' 2 (to) - i4(*o)lft(*o) ¥= 0 
Then the initial value problem 

y" + p(t)y' + q(t)y = 0 

y{to) = yo 
y'(to) = y' 0 . 



(20.23) 
(20.24) 

(20.25) 



has a solution, given by (20.17). 

Theorem 20.3. General Solution. Suppose that yi and y 2 are solutions 
of 

y"+p(t)y' + q(t)y = 0 (20.26) 
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such that for some point to the Wronskian 

W(t 0 ) = yi(t 0 )y' 2 (t 0 ) - y[(t 0 )y 2 (t 0 ) ? 0 (20.27) 

then every solution of (20.26) has the form 

y{t) = A Vl {t) + By 2 {t) (20.28) 

for some numbers A and B. In this case y\ and y 2 are said to form a 
fundamental set of solutions to (20.26). 

Theorem 20.4. Let / and g be functions. If their Wronskian is nonzero 
at some point to then they are linearly independent. 

Proof. Suppose that the Wronskian is non-zero at some point £q. Then 



W(f,g)(t 0 ) 

hence 



/(to) 9(h) 

/'(to) g'(h) 



^ 0 (20.29) 



/(toV(to) - <?(to)/'(to) ? 0 (20.30) 

We will prove the result by contradiction. Suppose that / and g are linearly 

dependent. Then there exists some non-zero constants A and B such that 
for all t, 

Af(t) + Bg(t) = 0 (20.31) 

Differentiating, 

Af'(t) + Bg'{t) = 0 (20.32) 

which holds for all t. Since (20.31) and (20.32) hold for all t, then they hold 
for t = to. Hence 

A/(to) + Bg(t Q ) = 0 (20.33) 
Af{tv)+Bg'(t Q ) = 0 (20.34) 

We can write (20.33) as a matrix: 

0 (20.35) 

From linear algebra, since A and B are not both zero, we know that the 
only way that this can be true is the determinant equals zero. Hence 

f{to)9'{t 0 ) - g(t 0 )f'(t 0 ) = 0 (20.36) 

This contradicts equation (20.30), so some assumption we made must be 
incorrect. The only assumption we made was that / and g were linearly 
dependent. 

Hence / and g must be linearly independent. □ 



/(to) g(to)~ 




'A 


/'(to) <?'(to)_ 




B 
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Example 20.3. Show that y = sint and y = cost are linearly independent. 
Their Wronskian is 

W(t) = (sin t) (cost)' - (cost) (sin t)' (20.37) 
= - sin 2 t - cos 2 t (20.38) 
= -1 (20.39) 

Since W(t) ^ 0 for all t then if we pick any particular t, e.g., t = 0, we have 
W(0) ^ 0. Hence sint and cost are linearly independent. □ 

Example 20.4. Show that y = sint and y — t 2 are linearly independent. 
Their Wronskian is 

W{t) = (sint)(t 2 )' - (t 2 )(sint)' (20.40) 
= 2t sin t-t 2 cost (20.41) 

At t = 7r, we have 

W(tt) = 27TSin7T - 7T 2 COS7T = 7T 2 ^ 0 (20.42) 

Since W(n) =/= 0, the two functions are linearly independent. □ 

Corollary 20.5. If / and g are linearly dependent functions, then their 
Wronskian must be zero at every point t. 

Proof. If W(f,g)(to) ^ 0 at some point to then theorem (20.4) tells us that 
/ and g must be linearly independent. But / and g are linearly dependent, 
so this cannot happen. Hence their Wronskian can never be nonzero. □ 

Suppose that yi and y% are solutions of y" + p(t)y' + q(t)y = 0. Then 

W(y 1 ,y 2 )(t)=y 1 y' 2 -y 2 y' 1 (20.43) 

Differentiating, 

±W( yi> y 2 )(t) = yiy'i + y[y 2 ~ V^v'i - vWx (20.44) 

= Viv'i - V2V'[ (20.45) 

Since y\ and y 2 are both solutions, they each satisfy the differential equa- 
tion: 

y'l+piM+q^y^O (20.46) 

y'2+p(t)y'2 + q(t)y2 = o (20.47) 
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Multiply the first equation by y 2 and the second equation by y\ , 

y'lV2 + p(t)y' iy 2 + q{t)yiy 2 = 0 (20.48) 
2/22/1 + P(t)y' 2 yi + q{t)ym = 0 (20.49) 

Subtracting the first from the second, 

2/12/2 - V2y'l + yiv' 2 p(t) - yiy"p{t) = o (20.50) 

Substituting (20.45), 

W'(t) = -p{t)W{t) (20.51) 
This is a separable differential equation in W; the solution is 

W(t) = Cexp ^- J p(t)dtj (20.52) 

This result is know is Abel's Equation or Abel's Formula, and we summarize 
it in the following theorem. 

Theorem 20.6. Abel's Formula. Let y\ and y% be solutions of 

y" +p(t)y' + q(t)y = 0 (20.53) 
where p and q are continuous functions. Then for some constant C, 



W( yi ,y 2 )(t) = Cexp I - J p{t)dt\ (20.54) 

Example 20.5. Find the Wronskian of 

y" - 2tsm(t 2 )y' + ysmt = 0 (20.55) 

up to a constant multiple. 
Using Abel's equation, 

W(t) = Cexp (J 2tsin(t 2 )dt\ = Ce~ coat2 □ (20.56) 

Note that as a consequence of Abel's formula, the only way that W can be 
zero is if C — 0; in this case, it is zero for all t. Thus the Wronskian of 
two solutions of an ODE is either always zero or never zero. If 

their Wronskian is never zero, by Theorem (20.4), the two solutions must 
be linearly independent. On the other hand, if the Wronskian is zero at 
some point £q then it is zero at all t, and 



W(y u y 2 )(t) = 



2/i (*) 2/2 (t) 
2/i (*) 2/2 (0 



= 0 (20.57) 
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yi(t) V2{t) 




A 


_y[(t) y'2 (*). 




B 



and therefore the system of equations 

,1 \ A'} 

= 0 (20.58) 

has a solution for A and B where at least one of A and B are non-zero. 
This means that there exist A and B, at least one of which is non-zero, 
such that 

A Vl (t) + By 2 (t) = 0 (20.59) 

Since this holds for all values of t, y\ and 2/2 are linearly dependent. This 
proves the following theorem. 

Theorem 20.7. Let yi and y 2 be solutions of 

y" +P(t)y' + q(t)y = 0 (20.60) 
where p and q are continuous. Then 

1. yi and 2/2 are linearly dependent W(yi, 2/2) (0 = 0 for all i. 

2. yi and 2/2 are linearly independent ^(2/1, 2/2)(i) 7^ 0 for all t. 

We can summarize our results about the Wronskian of solutions and Linear 
Independence in the following theorem. 



Theorem 20.8. Let 2/1 (t) and 2/2 (*) be solutions of 

J/" + «(*)!/ = 0 (20.61) 

Then the following statements are equivalent: 

1. 2/1 and 2/2 form a fundamental set of solutions. 

2. 2/1 and 2/2 are linearly independent. 

3. At some point to, W(yi, t/2)(io) 7^ 0. 

4. W(2/i,2/ 2 )(*)^OioraiH. 
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Lesson 21 



Reduction of Order 



The method of reduction of order allows us to find a second solution to the 
homogeneous equation if we already know one solution. Suppose that y\ is 
a solution if 

y"+p(t)y' + q(t)y = 0 (21.1) 
then we look for a solution of the form 

V2 = g{t)yi(t) (21.2) 

Differentiating twice, 

y'2 = 9y'i + g'yi (21.3) 

y'i = gy" + 2 g'y[ + g'vi ( 21 - 4 ) 

Substituting these into (21.1), 

gy'l + 2g'y' 1 + g"y x + V gy\ + pg'y 1 + qg Vl = 0 (21.5) 

Wi + vw" + pg'yi + (y" + py'i + qyi)a = o (21.6) 

Since y\ is a solution of (21.1), the quantity in parenthesis is zero. Hence 

y 1 g" + (2y' 1 +py 1 )g' = 0 (21.7) 

This is a first order equation in z = g', 

Vl z' + (2y[+py 1 )z = 0 (21.8) 
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which is separable in z. 



1 dz 
z dt 

lnz 



2 v'i +pvi _ _ 9 y± _ n 

— z p 

yi yi 



-2ln Vl - 
1 

Vi(t) 



Since z = g'(t), 



git) 



i 

m 



exp 



pdt 
pdt 
p{t)dt 



p(t)dt dt 



and since j/2 = gyi, the method of reduction of order gives 



!/?(*) 



exp - / p(t)dt dt 



Example 21.1. Use (21.14) to find a second solution to 

y" - 4y' + Ay = 0 



(21.9) 
(21.10) 
(21.11) 
(21.12) 

(21.13) 

(21.14) 
(21.15) 



given that one solution is y\ = e 2t . 

Of course we already know that since the characteristic equation is (r — 2) 2 = 
0, the root r = 2 is repeated and hence a second solution is y% = te 2t . We 
will now derive this solution with reduction of order. 



From equation (21.14), using p(t) = —4, 



— At 

e exp 



(e- 4t e 4t ) dt 



Adt dt 



dt 



te 2t □ 



(21.16) 

(21.17) 

(21.18) 

(21.19) 
(21.20) 
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The method of reduction of order is more generally valid then for equations 
with constant coefficient which we already know how to solve. It is usually 
more practical to repeat the derivation rather than using equation (21.14), 
which is difficult to memorize. 

Example 21.2. Find a second solution to 

y"+ty'-y = 0 (21.21) 

using the observation that y\ — t is a solution. 
We look for a solution of the form 

2/2 = ym = tu (21.22) 

Differentiating, 

y' 2 =tu' + u (21.23) 

y'2=tu" + 2u' (21.24) 

Hence from (21.21) 

tu" + 2u' + t 2 u' +tu-tu = 0 (21.25) 

tu" + 2u +t 2 u =0 (21.26) 

tz' + (2 + t 2 )z = 0 (21.27) 

where z = v! . Rearranging and separating variables in z, 

ldz 2 + t 2 2 

-— = = t 21.28 

z dt t t v ' 

1 dz f 2 f 

--fodt = - -dt- tdt (21.29) 

lnz = -21nt-^ 2 (21.30) 

z=\e- {1 ' 2 (21.31) 
t l 

du 1 f 2 /9 



Therefore 



or 



u(t) = J r 2 e"* /2 dt (21.33) 

Thus a second solution is 

y 2 = tu = t I t~ 2 e~ t2/2 dt (21.34) 
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Substitution back into the original ODE verifies that this works. Hence a 
general solution of the equation is 



y 



= At + Bt J t~ 2 e~^ /2 dt □ (21.35) 



Example 21.3. Find a second solution of 

t 2 y" - Aty' + 6y = 0 (21.36) 

assuming that t > 0, given that yx = t 2 is already a solution. 
We look for a solution of the form y 2 = u Vi = ut 2 . Differentiating 

y' 2 = u't 2 + 2tu (21.37) 
y% = u"t 2 + Atu' + 2u (21.38) 

Substituting in (21.36), 

0 = t 2 (u"t 2 + Atu' + 2u) - At(u't 2 + 2tu) + Qui 2 (21.39) 
= t A u" + At 3 u' + 2t 2 u - 4t 3 u' - 8t 2 u + U 2 u (21.40) 
= t A u" (21.41) 

Since t > 0 we can never have t = 0; hence we can divide by t A to give 
u" = 0. This means u — t. Hence 

V% = u Vl = t 3 (21.42) 

is a second solution. □ 

Example 21.4. Show that 

m = (21.43) 
is a solution of Bessel's equation of order 1/2 

t 2 y" + ty' +(t 2 --^jy = Q (21.44) 

and use reduction of order to find a second solution. 
Differentiating using the product rule 

yi = !(V 1/2 sini) (21.45) 

= i _1/2 cosi- -r 3/2 sini (21.46) 

y'l = -r 1/2 sint-t- 3/2 cost+ ^t~ 5/2 sint (21.47) 



Plugging these into Bessel's equation, 

t 2 (-r 1/2 sint - i~ 3/2 cost + ^t~ 5/2 smtj + 

t ^V 1/2 cost - ^t~ 3/2 smtj + (t 2 - ^ t~ 1/2 sin t = 0 

(-t 3/2 sint - t~ 1/2 cost + ^i 1/2 sin^ + 

^t 1/2 cost- ^t~ 1/2 smtj + t 3/2 sint- ^t~ 1/2 sint = 0 

All of the terms cancel out, verifying that yi is a solution. 
To find a second solution we look for 

1)2 = uyi = ut~ x ' 2 sint 

Differentiating 

y' 2 = u't~ 1/2 smt - ^ut- 3/2 sint + ut~ 1/2 cost 
y'2 = u"t~ 1/2 smt- \u'r 3/2 sint + u'r 1/2 cost 



2 

- ^u't~ 3/2 smt + ^ut~ 5/2 sint- ^ut~ 3/2 cost 

+ u't~ 1/2 cos t - \ut~ s/2 cos t - ur 1/2 sin t 

= u"r 1/2 sint + u' (-t~ 3/2 sini + 2t~ 1/2 cost) + 

u (j r5/2 sint- t~ 3/2 cos t - t~ 1/2 sin/) 



Hence 



0 = t 



"r 1/2 sint + v' (-t~ 3/2 sint + 2t~ 1/2 cost) + 

+ t ^i't~ 1/2 sin t - 3/2 sint + ?it~ 1/2 cos 
+ ^t 2 - ^ ut~ 1/2 sint 
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All of the terms involving u cancel out and we are left with 

0 = u"t 3/2 sint + 2u't 3/2 cost (21.55) 
Letting z = v! and dividing through by i 3 / 2 sin t, 

0 = z' + 2zcoU (21.56) 



/? = -/ 



2 J cottdt (21.57) 

lnz = -21nsint (21.58) 

z = sm~ 2 t (21.59) 

Since z = v! this means 

du 1 . . 

— = — u = cott (21.60) 

Since y 2 (t) = uyi(t), 

cotfsint cost .„„ „ H . 

» " " (2L61) 

Thus the general solution is 

A sin t + B cos t „ . 

y = A yi +By 2 = □ (21.62) 



Method for Reduction of Order. Given a first solution w(t) to 
y" +p(t)y' + q(t)y = 0, we can find a second linearly independent solution 
v(t) as follows: 

1. Calculate the Wronskian using Abel's formula, 

w{t) = e -/p(*) d * 

2. Calculate the Wronskian directly a second time as 

W(t) = u'(t)v(t) - v'{t)u(t) 

3. Set the two expressions equal; the result is a first order differential 
equation for the second solution v(t). 

4. Solve the differential equation for v(t). 

5. Then general solution is then y = Au{t) + Bv(t) for some constants 
A and B. 
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Example 21.5. Find a second solution to the differential equation 

ty" + 10y' = 0 (21.63) 
given the observation that yi(t) = 1 is a solution. 
Since p(t) = 10 /t, Abel's formula gives 



W(t) = e -/( 10 /*)^ =t -w 



By direct calculation, 

W(t) 



yi 


2/2 




i 


2/2 








0 


y'2 



V2 



Equating the two expressions for W, 

Therefore, tj2 = — (l/9)i -9 ; the general solution to the homogeneous equa- 
tion is 

y = C lVl + C 2 y 2 = c\ + c 2 t- 9 . 

Example 21.6. Find a fundamental set of solutions to 



(21.64) 
(21.65) 

(21.66) 
s equa- 

(21.67) 



t 2 y" + 5ty' -5y = 0 
given the observation that y\ = t is one solution. 
Calculating the Wronskian directly, 



W{t) 



t 2/2 
1 2/2 



= ty' 2 - 2/2 



(21.68) 



(21.69) 



(21.70) 



From Abel's Formula , since p(t) = ai{t)/a 2 {t) = 5/i, 

w(t) = e -f^ dt =t~ 5 

Equating the two expressions and putting the result in standard form, 

2/ 2 ~ (V%2 - r 6 (21.71) 

An integrating factor is 

H{t) = e /(" 1 /t)^ = i/ t (21.72) 

Therefore 

(21.73) 



y' 2 = tj (l/t)t- 



y dt = t 



= -r 



The fundamental set of solutions is therefore {t, t 5 }. 
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Lesson 22 



Non- homogeneous 
Equations with Constant 
Coefficients 

Theorem 22.1. Existence and Uniqueness. The second order linear 
initial value problem 

a(t)y" + b(t)y' + c(t)y = fm 

tf(*o) = Vo > (22.1) 

y(*o) = yi J 

has a unique solution, except possibly where a(t) = 0. In particular, the 
second order linear initial value with constant coefficients, 

ay" + by' + cy = f(tU 

y(to) = yo > (22.2) 
y(to) =v\ J 

has a unique solution. 

We will omit the proof of this for now, since it will follow as an immediate 
consequence of the more general result for systems we will prove in chapter 
(26). 

Theorem 22.2. Every solution of the differential equation 

ay" + by' + cy = f{t) (22.3) 
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has the form 

y{t) = Ay H1 (t) + By H2 (t) + y P (t) (22.4) 
where yui and yn 2 are linearly independent solutions of 

ay" + by' + cy = 0 (22.5) 

and yp(t) is a solution of (22.3) that is linearly independent of yni and 
yH2- Equation (22.4) is called the general solution of the ODE (22.3). 
The two linearly independent solutions of the homogeneous equation are 
called a fundamental set of solutions. 

General Concept: To solve the general equation with constant coeffi- 
cients, we need to find two linearly independent solutions to the homo- 
geneous equation as well as a particular solution to the non-homogeneous 
solutions. 



Theorem 22.3. Subtraction Principle. If ypi(t) and yp2(t) are two 
different particular solutions of 

Ly = f(t) (22.6) 

then 

yH(t) = ypi{t)-y P2 (t) (22.7) 
is a solution of the homogeneous equationXy = 0. 



Proof. Since 



Then 



Ly P1 = f(t) (22.8) 
Ly P2 = f(t) (22.9) 



L(ypi -Vp2) = Ly P1 - Ly P2 (22.10) 

= /(*) - /(*) (22.11) 

= 0 (22.12) 

Hence yn given by (22.7) satisfies Lyn = 0. □ 

Theorem 22.4. The linear differential operator 

Ly = aD 2 y + bDy + cy (22.13) 

can be factored as 

Ly = (aD 2 + bD + c)y = a(D - n)(D - r 2 )y (22.14) 



where n and r 2 are the roots of the characteristic polynomial 

ar 2 + br + c = 0 
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Proof. Using the quadratic equation, the roots of the characteristic poly- 
nomial satisfy 



-6 + \Jb 2 - 4ac -b - \Jb 2 - 4ac 
n + r 2 = q + ^ 

la la 



r\ri 




hence 



b = -a{n+r 2 ) (22.18) 
c = arxr 2 (22.19) 



Thus 



Ly = ay" + by' + cy 

= ay" - a{ri + r 2 )y' + ar x r 2 y 

= a[y" - (n + r 2 )y' + nt^y] (22.20) 

= a(D - ri)(y' - r 2 y) 

= a{D - ri )(D - r 2 )y 

Hence L = a(D — ri)(D — r 2 ) which is the desired factorization. □ 



Theorem (22.4) provides us with the following simple algorithm for solving 
any second order linear differential equation or initial value problem with 
constant coefficients. 
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Algorithm for 2nd Order, Linear, Constant Coefficients IVP 


To solve the initial value problem 




ay" + by' + cy = f(ty 

y(h) = yo 
y'(t 0 ) = yi t 


> (22.21) 


1. Find the roots of the characteristic polynomial ar 2 + br + c = 0. 


2. Factor the differential equation as a(D — ri) (D — T2)y — fit)- 




*(*) 


3. Substitute z = {D — r%)y = y 1 — r-^y to get 


o(D - n)« = f(t). 


4. Solve the resulting differential equation z' 


— r\z = -fU) for z(t). 
a 


5. Solve the first order differential equation y 
the solution you found in step (4). 


— r2y = z(t) where z(t) is 


6. Solve for arbitrary constants using the initial conditions. 


Example 22.1. Solve the initial value problem 




,i/"-10y' + 21y^3sint > 
2/(0) = 1 
2/(0) = 0 t 


> (22.22) 


The characteristic polynomial is 




r 2 - lOr + 21 = (r- 3)(r - 


7) (22.23) 


Thus the roots are r = 3, 7 and since a = 1 (the coefficient of y"), the 
differential equation can be factored as 


(.D-3) (D-7)y = 3sint 


(22.24) 


To solve equation (22.24) we make the substitution 


z = (D-7)y = y'- 7y 


(22.25) 


Then (22.24) becomes 




(D - 3)z = 3sin< 
z' — 3z = 3 sin t 


(22.26) 
(22.27) 
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This is a first order linear equation. An integrating factor is /j, = e 34 . Mul- 
tiplying both sides of (22.27) by fi, 



-3t\ 



dt 



= 3e~ 3 * sin* 



(22.28) 



Integrating, 



ze~ 3t = 



3 f e~ 3t sintdt = — e~ 3t (-3sint - cost) + C 
J 10 V ' 



(22.29) 



z = — — (3sin£ + cost) + Ce 



-3* 



(22.30) 



Substituting back for z = y' — 7y from equation (22.25) gives us 



y' - 7y = - — (3 sin t + cos t) + Ce 3 * 



(22.31) 



This is also a first order linear ODE, which we know how to solve. An 
integrating factor is /i = e~ 7t . Multiplying (22.31) by \i and integrating 
over t gives 



(y>-7y)(e~ 7t ) = 
d 



dt 



[ye 



-7t\ 



- — (3 sin f + cos t) + Ce 3t 



10 



e^ 7 *(3sini + cosi) + Ce~ 4t 



ye~ 7t = 



3 
10 



(p- 7t ) (22.32) 
(22.33) 
dt (22.34) 
y e - 7t (3sint + cos t)dt + C J e- 4t dt (22.35) 



- — e- 7t (3sini + cost) + Ce- 4t 



Integrating the last term would put a —4 into the denominator; absorbing 
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this into C and including a new constant ol integration C gives 



— 7t ^ 

ye = "io 



J e- 7t watdt ~ Yq J e " U costtdt + Ce~ 4t + C (22.36) 



-le--(cost + 7sin0 



10 \50 

-7t 



' 1 1 (mat - 7 cost) ) + Ce~ 4t + C" (22.37) 



9 63 3 21 

= e~ ' c I cos t H sin i sin t H cos t 

\500 500 500 500 

+ Ce- U + C (22.38) 

= \e~ 7t (3 cos f + 6 sin t) + Ce~ 4t + C (22.39) 
50 

V = ^ (3 cos f + 6 sin f ) + Ce 3 * + C V 7t (22.40) 
ou 

The first initial condition, y(0) = 1, gives us 

1 = ^-+C + C (22.41) 
50 

To apply the second initial condition, y'(0) = 0, we need to differentiate 
(22.40) 

y' = — (-3 sin t + 6 cos t) + 3Ce 3 * - 7C"e~ 7 * (22.42) 
ou 

Hence 

0 = — + 3C - 7C" (22.43) 
50 



Multiplying equation (22.41) by 7 



7 = — + 7C + 7C" (22.44) 
50 

Adding equations (22.43) and (22.44) 

7 =I +ioc =* c =H < 22 - 45 > 

Substituting this back into any of (22.41), (22.43), or (22.44) gives 

147 

C = — (22.46) 

500 1 ' 

hence the solution of the initial value problem is 

1 323 147 

y = -(3cos* + 6( dnt) + — + — e"« □ (22.47) 
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Theorem 22.5. Properties of the Linear Differential Operator. Let 



L = aD 2 + bD + c (22.48) 

and denote its characteristic polynomial by 

P(r) = ar 2 + br + c (22.49) 

Then for any function y(t) and any scalar r, 

Ly = P(D)y (22.50) 

Le rt = P(r)e rt (22.51) 

Lye rt = e rt P(D + r)y (22.52) 

Proof. To demonstrate (22.50) we replace r by D in (22.49): 

P{D)y = (aD 2 + bD + c)y = Ly (22.53) 

To derive (22.51), we calculate 

Le rt = a(e rt )" + b(e rt )' + c{e rt (22.54) 

= ar 2 e rt + bre rt + ce rt (22.55) 

= (ar 2 + br + c)e rt (22.56) 

= P(r)e rt (22.57) 

To derive (22.52) we apply the differential operator to the product ye rt and 
expand all of the derivatives: 

Lye rt = aD 2 (ye rt ) + bD(ye rt ) + cye rt (22.58) 

= a(ye rt )" + b(ye rt )' + cye rt (22.59) 

= a(y'e rt + rye rt )' + b{y'e rt + rye rt ) + cye rt (22.60) 
= a{y"e rt + 2ry'e rt +r 2 ye rt ) 

+ b{y'e rt + rye rt ) + cye rt (22.61) 

= e rt [a(y" + 2ry' + r 2 y) + b(y' + ry) + cy] (22.62) 

= e rt [a(D 2 + 2Dr + r 2 )y + b(D + r)y + cy] (22.63) 

= e rt [a(D + rfy + b(D + r)y + cy] (22.64) 

= e rt [a(D + r) 2 + b(D + r) + c] y (22.65) 

= e rt P{D + r)y (22.66) 

□ 
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Derivation of General Solution. We are now ready to find a general 
formula for the solution of 

ay" + by' + cy = f(t) (22.67) 

where a ^ 0, for any function f(t). We begin by dividing by a, 

y" + By' + Cy = q(t) (22.68) 

where B — b/a, C — c/a, and q(t) = f(t)/a. By the factorization theorem 
(theorem (22.4)), (22.68) is equivalent to 

(D - n)(D - r 2 )y = q(t) (22.69) 

where 

ri, a = \(-B± VB 2 - 4C) (22.70) 

Defining 

z=(D- r 2 )y = y' - r 2 y (22.71) 
equation (22.69) becomes 

(D-n)z = q(t) (22.72) 

or equivalently, 

z' - nz = q(t) (22.73) 
This is a first order linear ODE in z{t) with integrating factor 



H{t) = exp (J-ndtj = e~ rit 



and the solution of (22.73) is 



(22.74) 



Using (22.71) this becomes 

V - r 2 y = P(t) (22.76) 

where 

p(t) = fj q (t)iM(t)dt + dj (22.77) 
Equation (22.76) is a first order linear ODE in y(t); its solution is 

= -7z( [ P(t>(t)dt + C 2 J (22.78) 



(*) 
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where 

u(t) = cxp —r 2 dt 
Using (22.77) in (22.78), 

C2_ 

v{t) 

q(t)n(t)dt + C*i 



y(t) 



i 

W) 

1 
1 



p(t)u(t)dt 



1 

W) 



v(t)dt- 
dt 



C 2 

c 2 



1 /■ v{t) 



, , , q(t)u(t)dt dt + —- / , \ dt + 



(22.79) 

(22.80) 
(22.81) 
(22.82) 
(22.83) 



Substituting /j, = e Tlt and v = e 1-2 *, 

„( t ) . e « / (/ ?(()e -«, t ) * + C ie - / + C 2e « 

(22.84) 

If r\ ^ r2, then 



,(ri— ra)i 



n - r 2 



(22.85) 



and thus (when ri 7^ ^2), 

sW =e"'/«<— >'(/*)e-^)* + ^- + C ^. (2, 86 > 

Note that the Ci in (22.86) is equivalent to the C\ in (22.88) divided by 
(ti — r 2 ); since C\ is arbitrary constant, the n — r2 has been absorbed into 
it. 

If ri = r% = r in (22.88) (this occurs when £? 2 = AC and hence r = —5/2 = 
-b/2a), then 

' e (r 1 -r 3 )t dt = t (22.87) 



(22. 



hence when r± = r 2 = r, 

y(t) = e rt / f / q(t)e~ rt dt ) dt + (Cit + C 2 )e rt 



Thus the homogeneous solution is 



Vh 



Cie rit + C 2 e r2t if n ^ r 2 
(C\t + C 2 )e rt if n = r 2 = r 



(22.89) 
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and the particular solution, in either case, is 

Returning to the original ODE (22.67), before we defined q(t) = f(t)/a, 

y P = V 2 ' J e (^-^)* f(t)e- rit d?j dt (22.91) 

We have just proven the following two theorems. 



Theorem 22.6. The general solution of the second order homogeneous 
linear differential equation with constant coefficients, 

ay" + by' + cy = 0 (22.92) 



y H = {^ rit + C rT ifri ^ 2 (22.93) 

\{Cit + C 2 )e rt if r 1= r 2 =r V ; 

where r± and ri are the roots of the characteristic equation 

ar 2 + br + c = 0 (22.94) 



Theorem 22.7. A particular solution for the second order linear differen- 
tial equation with constant coefficients 

ay" + by' + cy = f(t) (22.95) 

is 

yp = 1 e r2t / e {ri - r2)t ( [ f(t)e- rit dt) dt (22.96) 



a 

where r% and ri are the roots of the characteristic equation 

ar 2 + br + c = 0 (22.97) 



Example 22.2. Solve the initial value problem 



it \ 



y" -9y = e 

y(o) = 1 

2/(0) = 2 J 



(22.98) 
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The characteristic equation is 

r 2 - 9 = (r - 3)(r + 3) = 0 => r = ±3 (22.99) 

Thus the solution of the homogeneous equation is 

y H = Ae 3t + Be~ 3t (22.100) 

From equation (22.96) with a = 1, ri — 3, r2 = —3, and /(i) = e 2t , a 
particular solution is 

y P = V 2 * J e (ri - r2)t (j f(t) e - rit d?j dt (22.101) 

3t / Jot 



e 



j>(j>^> (22 - 102) 



3t / „6t ( / „— t 



e / e / e 



-3f / e 6i e -t 



di di (22.103) 



f di (22.104) 
-e~ 3t J e 5t dt (22.105) 
' (22.106) 



-e " 3t e 5t 



5 

Hence the general solution is 



5 

e 2t (22.107) 



y = Ae 3t + Ber 3t - 1 e 2t (22.108) 
5 

The first initial condition gives 

1 = A + B -- =*> B = - - A (22.109) 
5 5 

To apply the second initial condition we must differentiate (22.108): 

y' = 3Ae 3t - 3Be" 3t - \e 2t (22.110) 
o 

hence 

2 = 3/1-35- % ^ =3A-35 (22.111) 
5 5 
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From (22.109) 

^■ = 3A-3^~-Aj (22.112) 
1 8 

= 6A-y (22.113) 

30 

— =6A (22.114) 
5 

A=l (22.115) 

B= 6 -A=- (22.116) 
5 5 

Consequently 

y = e 3t + -e~ 3t - -e M (22.117) 

5 5 

is the solution of the initial value problem. □ 



Lesson 23 



Method of Annihilators 



In this chapter we will return to using the D operator to represent the 
derivative operator. In particular, we will be interested the general n th 
order linear equation with constant coefficients 

a n D n y + a n -xD n ~ l y + ■■■+ a x Dy + a Q y = g(t) (23.1) 

which we will represent as 

Ly = g(t) (23.2) 

where L is the operator 

L = a n D n + dn-iD"- 1 + ■■■ + aiD + a 0 (23.3) 

As we have seen earlier (see chapter 15) the L operator has the useful 
property that it can be factored 

L = (D-n)(D-r 2 )---(D-r n ) (23.4) 

where ri , . . . , r n are the roots of the characteristic equation 

a n r n + a n _ir" _1 H h a x r + a 0 = 0 (23.5) 

Definition 23.1. An operator L is said to be an annihilator of a function 
f(t) ifi/ = 0. 

A solution of a linear homogeneous equation is then any function that can 
be annihilated by the corresponding differential operator. 

Theorem 23.2. D n annihilates £ n_1 . 
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Since 

Dl = 0 =>■ D annihilates 1 (23.6) 

D 2 t = 0 =>■ D 2 annihilates t (23.7) 

D 3 t 2 = 0 => D 3 annihilates t 2 (23.8) 

: (23.9) 

D n t n-i = o =^ D« annihilates t* -1 (23.10) 
Theorem 23.3. (D - a) n annihilates t"- 1 e°'. 

Proof, (induction). For n — 1, the theorem states that D — a annihilates 
e°*. To verify this observe that 

(D - a)e at = De at - ae at = ae at - ae at = 0 (23.11) 

hence the conjecture is true for n = 1. 

Inductive step: Assume that (D — a) n annihilates t n ~ 1 e at . Thus 

(D - a) n t n - l e at = 0 (23.12) 

Consider 

(D - a) n+ H n e at = {D- a) n {D - a)t n e at (23.13) 

= {D- a) n {Dt n e at - at n e at ) (23.14) 

= (D - a)"(ni™~ 1 e Qt + t n ae af - at n e at ) (23.15) 

= {D- a) n nt n ~ l e at (23.16) 

= n{D - o) n t n-1 e ot (23.17) 

= 0 (23.18) 

where the last line follows from (23.12). □ 

Theorem 23.4. (D 2 + a 2 ) annihilates any linear combination of cosaa; and 
sin ax 

Proof. 

(D 2 + a 2 )(Asinat + Bcosat) = AD 2 smat + Aa 2 sincrf (23.19) 

+ BD 2 cos at + a 2 B cos at (23.20) 

= -Aa 2 sin at + Aa 2 sin at+ (23.21) 

- Ba s cos at + a 2 B cos at (23.22) 

= 0 (23.23) 

□ 
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Theorem 23.5. (D 2 - 2aD + (a 2 + b 2 )) n annihilates t n ~ 1 e at cosbt and 
t n-i e at gin w _ 



Proof. For n=l . 

(D 2 - 2aD + (a 2 + b 2 )) 1 t 1 - 1 e at sinbt 

= (D 2 - 2aD + a 2 + b 2 ) (e at sin bt) (23.24) 

= ((D - a) 2 + b 2 )(e at sinbt) (23.25) 

= (D-a)(D- a) (e at sin bt) + b 2 e at sin bt (23.26) 

= (D - a)(ae at sinbt + be at cosbt - ae at sinbt) + b 2 e at sinbt (23.27) 

= (D - a)(be at cosbt) + b 2 e at sinbt (23.28) 

= abe at cos bt ~ b 2 e at sin bt - abe at cos bt + b 2 e at sin bt (23.29) 

= 0 (23.30) 

For general n, assume that (D 2 - 2aD + (a 2 + b 2 )) n t n ^ 1 e at cosbt = 0 and 
similarly for sin bt. Consider first 

(D 2 - 2aD + (a 2 + b 2 ))t n e at cos bt (23.31) 

= [(£> - a) 2 + b 2 } (t n e at cos bt) (23.32) 

= (D - a) 2 (t n e at cosbt) + b 2 (t n e at cosbt) (23.33) 
= (D-a) [nt n - 1 e at cos bt + at n e at cos bt - bt n e at sin bt] 

+ b 2 (t n e at cosbt) (23.34) 
= n(n - l)t"- 2 e at cos bt + nat n - 1 e at cos bt - n&f^V* sin bt 

+ nat n - x e at cos bt + a 2 t n e at cos bt - abt n e at sin bt 

- bnt n - 1 e at sinbt - abt n e at sinbt - b 2 t n e at cosbt 

- ant n - 1 e at cosbt - a 2 t n e at cosbt + abt n e at sinbt 

+ b 2 t n e at cosbt (23.35) 
= n(n - l)t n - 2 e at cos bt + nat n - 1 e at cos bt - nbt n - x e at sin bt 

- abt n e at sinbt - bnt n - 1 e at sinbt (23.36) 

The last line only contains terms such as 

t"-V*cos&i (23.37) 

t"-V*sinfa (23.38) 



t"-V*cos&i (23.39) 
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But by the inductive hypothesis these are all annihilated by (D 2 — 2aD + 
(a 2 + b 2 )) n . Hence (D 2 - 2aD + (a 2 + b 2 )) n+1 annihilates t n e at cos bt. A 
similar argument applies to the sin&i functions, completing the proof by 
induction. □ 

Example 23.1. To solve the differential equation 

y" -6y , + 8y = t (23.40) 

We first solve the homogeneous equation. Its characteristic equation is 

r 2 -6j/ + 8 = 0 (23.41) 

which has roots at 2 and 4, so 

y H = de 2 t + C 2 eH (23.42) 

Then we observe that D 2 is an annihilator of t. We rewrite the differential 
equation as 

(D 2 -QD + 8)y = t (23.43) 
D 2 (D 2 - 6D - 8)y = D 2 = 0 (23.44) 

(23.45) 

The characteristic equation is 

r 2 (r-4)(r- 2) = 0 (23.46) 
so the roots are 4,2,0, and 0, giving us additional particular solutions of 

y P = At + B (23.47) 

The general solution is 

y = C x e 2 t + C 2 eH + At + B (23.48) 
To find A and B we differentiate, 

y' P = A (23.49) 
y P = 0 (23.50) 

Substituting into the original differential equation, 

0 -6A + 8(At + B) =t (23.51) 

Equating coefficients gives A = 1/8 and 8B = 6A = 3/4 B = 3/32. 

Hence 

y = C 1 e 2 t + C 2 eH+\t+ A (23.52) 
o oz 

The constants C\ and C 2 depend on initial conditions. □ 
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The method of annihilators is really just a variation on the method of 
undetermined coefficients - it gives you a way to remember or get to the 
functions you need to remember to get a particular solution. To use it to 
solve Ly = g(t) you would in general use the following method: 



1. Solve the homogeneous equation Ly — 0. Call this solution y H . 



2. Operate on both sides of Ly = g with some operator L' so that 
L 'Ly = L'g = 0, i.e., using an operator that annihilates g. 



3. Find the characteristic equation of L' Ly = 0. 



4. Solve the homogeneous equation L' Ly = 0. 



5. Remove the terms in the solution of L' Ly = 0 that are linearly de- 
pendent on terms in you original solution to Ly = 0. The terms that 
remain are your y p . 



6. Use undetermined coefficients to determine any unknowns in your 
particular solution. 



7. The general solution is y = jjh + y P where Ly H = 0. 
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Lesson 24 



Variation of Parameters 



The method of variation of parameters gives an explicit formula for 
a particular solution to a linear differential equation once all of the homo- 
geneous solutions are known. The particular solution is a pseudo-linear 
combination of the homogeneous equation. By a pseudo-linear combina- 
tion we mean an expression that has the same form as a linear combination, 
but the constants are allowed to depend on t: 

y P = u 1 {t)y 1 +u 2 {t)v2 (24.1) 

where u\{t) and u/t) are unknown functions of t that are treated as param- 
eters. The name of the method comes from the fact that the parameters 
(the functions u\ and u 2 in the linear combination) are allowed to vary. 

For the method of variation of parameters to work we must already know 
two linearly independent solutions to the homogeneous equations 

Suppose that y\{t) and y 2 (t) are linearly independent solutions of 

a{t)y" + b(t)y' + c(t)y = 0 (24.2) 
The idea is to look for a pair of functions u(t) and v(t) that will make 

y P = u(t) yi + v(t)y 2 (24.3) 

a solution of 

a(t)y" + b(t)y' + c(t)y = f(t). (24.4) 
Differentiating equation (24.3) 

y'p = u'yi + uy[ + v'y 2 + vy 2 (24.5) 
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If we now make the totally arbitrary assumption that 

u'yi + v'y 2 = 0 (24.6) 

then 

y' P = uy[ + vy' 2 (24.7) 

and therefore 

y" P = u'y[ + uy'l + v'y' 2 + vy' 2 ' (24.8) 

From equation (24.4) 

f{t) = a(t)(u'^ + uy'l + v'y' 2 + vy' 2 ') 

+ b(t) (uy[ + vy' 2 ) + c(t) (uyi + vy 2 ) (24.9) 
= a{t) {u'yi + v'y' 2 ) + u [a{t)y'{ + b(t)y[ + c(t) yi ] 

+ v[a(M + b(t)y' 2 + c(t)y 2 ] (24.10) 
= a(t)(u'y' 1 +v'y' 2 ) (24.11) 
Combining equations (24.6) and (24.11) in matrix form 



yx y%\ W \_ o 

V'l V2 \ v ~ \ f(t)/a(t) 



(24.12) 



The matrix on the left hand side of equation (24.12) is the Wronskian, 
which we know is nonsingular, and hence invertible, because y\ and y 2 
form a fundamental set of solutions to a differential equation. Hence 




«' A _ ( vi V2 \ ( o 
«' J ~ \v'i v'2 ) \ f(t)/<t) 

V2 -V2\f o 
-y[ yi J\ f(t)/a(t) 
-y2f(t)/a(t) 

W{t) V Vif{t)/a{t) 
where W(t) = y\y' 2 — y 2 y[- Hence 

du _ -y2f(t) 

dt ~ a(t)W(t) 
dv_ = yifjt) 
dt a{t)W(t) 

Integrating each of these equations, 



(24.13) 



(24.14) 
(24.15) 



u(t) = - / y^\dt (24.16) 



a(t)W(t) 

(t)f(t) 
a(t)W(t)' 



v[t) = I y -^Mdt (24.17) 



207 



Substituting into equation (24.3) 



VP 



-Hi 



y 2 f(t) 

a(t)W(t) 



dt + y 2 



Vifjt) 
a(t)W(t)' 



■dt 



(24.18) 



which is the basic equation of the method of variation of parameters. It is 
usually easier to reproduce the derivation, however, then it is to remember 
the solution. This is illustrated in the following examples. 

Example 24.1. Find the general solution to y" — by' + 6y = e l 



The characteristic polynomial 



5r + 6 = (r — 3)(r — 2) =0, hence a 



fundamental set of solutions is y\ — e 3t , y 2 = e 2t . The Wronskian is 



W(t) = 

Since f(t) = e* and a(t) = 1, 



yp 



„31 



3e 3t 2e 2 



p 2t t 

~^dt + e 2t 



e 3 *e* 



o5t 



dt 



e~ 2t dt - e 2t / e~ l dt 



:e 4 + e* 



(24.19) 

(24.20) 
(24.21) 
(24.22) 



(We ignore any constants of integration in this method). Thus the general 
solution is 

y = VP + JJH = \e l + C ie 3t + C 2 e 2t □ (24.23) 

Example 24.2. Find a particular solution to y" — 5y' + 6y = t by repeating 
the steps in the derivation of (24.18) rather than plugging in the general 
formula. 

From the previous example we have homogeneous solutions y\ — e 3t and 
2/2 = e 2t . Therefore we look for a solution of the form 

y = u(t)e 3t +v(t)e 2t (24.24) 

Differentiating, 

y' = u'{t)e 3t + 3u(t)e 3t + v'(t)e 2t + 2v(t)e 2t (24.25) 
Assuming that the sum of the terms with the derivatives of u and v is zero, 



u'{t)e M + v'{t)e 2 



0 



(24.26) 
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and consequently 

y' = 3u(t)e 3t + 2v(t)e 2t (24.27) 

Differentiating, 

y" = 3u'{t)e 3t + 9u(t)e 3t + 2v'{t)e 2t + Av(t)e 2t (24.28) 
Substituting into the differential equation y" — 5y' + 6y = t, 

t = {3u'(t)e 3t + 9u(t)e 3t + 2v'(t)e 2t + Av{t)e 2t ) - 5{3u(t)e 3t + 2v(t)e 2t ) 

+ 6(u(t)e 3t + v{t)e 2t ) (24.29) 

=3u{t)'e 3t +2v{t)'e 2t (24.30) 

Combining our results gives (24.26) and (24.30) gives 

u'{t)e 3t +v'(t)e 2t = 0 (24.31) 
3u(t)'e 3t + 2v'{t)e 2t = t (24.32) 

Multiplying equation (24.31) by 3 and subtracting equation (24.32) from 
the result, 

v'(t)e 2t = -t (24.33) 
We can solve this by multiplying through by e~ 2t and integrating, 

v(t) = -J te~*dt = -("*- J) ^ = (2 + 4) ^ ( 2434 ) 
because / te at dt = [t/a - I /a 2 ] e at . 

Multiplying equation (24.31) by 2 and subtracting equation (24.32) from 
the result, 

u'{t)e 3t = t (24.35) 
which we can solve by multiplying through by e~ 3t and integrating: 



[ te- 3t dt = 


H- 


-IV"- 


-a- 















e~ M (24.36) 

Thus from (24.24) 

y = u{t)e 3t + v(t)e 2t (24.37) 

s + s)«-")«" + ((i + i)*-*)«" (24 - 38) 



t 1 t 1 

_ 3 ~ 9 + 2 + 4 
t 5 

6 + 36 



(24.39) 

□ (24.40) 
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Example 24.3. Solve the initial value problem 



t 2 y" -2y = 2f 
2/(1) = 0 
2/(1) = 1 



(24.41) 



given the observation that y — t 2 is a homogeneous solution. 

First, we find a second homogeneous solution using reduction of order. By 
Abel's formula, since there is no y' term, the Wronskian is a constant: 



w(t) = e -/° d * = C 

A direct calculation of the Wronskian gives 
W(t) 



t 2 V2 



t 2 y' 2 - 2ty 2 



(24.42) 



(24.43) 



2t y' 2 

Setting the two expressions for the Wronskian equal to one another gives 

t 2 y' -2ty = C (24.44) 

where we have omitted the subscript. This is a first order linear equation 
in j/;putting it into standard form, 



y 



2 c 
t y = T 2 



An integrating factor is fi = 2 /*) dt = e 21nt = t 2 , hence 

d y 



dt t 2 



= Ct~ 



Integrating both sides of the equation over t, 



y_ 

t 2 



C 



r 3 + a 



Multiplying through by t 2 



y = C^ 2 + 



9l 
t 



(24.45) 



(24.46) 



(24.47) 



(24.48) 



where C 2 = C / — 3. Since y\ = t 2 , we conclude that y 2 = 1/t. This gives 
us the entire homogeneous solution. 
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Next, wc need to find a particular solution; we can do this using the varia- 
tion of parameters formula. Since a(t) — t 2 and f(t) = 2i, we have 



VP 



-Viit) 



V2(t)f(t) 
a(t)W(t) 



dt + y 2 (t) 



yi (*)/(*) 

a(t)W(t) 



dt 



(24.49) 



We previously had W — C; but here we need an exact value. To get 
the exact value of C, we calculate the Wronskina from the now-known 
homogeneous solutions, 



C = W 



y'i y'2 



t z 

2t 



l/t 

-l/t 2 



= -3 



Using yi = t 2 , y 2 = l/t, f(t) = 2t, and a(t) = t 2 



yp = -t 1 



2t , 1 

dt+ - 

t-t 2 --3 t 



t 2 -2t 
t 2 ■ -3 



dt 



J t2<it ~Ytj tdt 



2? 

IT 
2_e_ -i 
~3 r 

2t t 

__ 3 ~ 3 



2_ f_ 
3t ' ~2 

-t 



Hence yp — —t and therefore 

y = VH + yp = C x t 2 + C 2 t-j 
From the first initial condition we have 0 = C\ + C 2 — 1 or 

C\ + C 2 = 1. 

To use the second condition we need the derivative, 

C2 , 



y = 2Ctt 



t 2 



hence the second condition gives 1 = 2C\ — C 2 — 1 or 

2d - C 2 = 2. 



(24.50) 

(24.51) 

(24.52) 

(24.53) 
(24.54) 

(24.55) 
(24.56) 
(24.57) 



Solving for C\ and C 2 gives C\ = 1, hence C 2 
solution of the initial value problem is 



y = t 2 



l 



□ 



(24.58) 
0, so that the complete 

(24.59) 



Lesson 25 



Harmonic Oscillations 



If a spring is extended from its resting length by an amount y then a restor- 
ing force, opposite in direction from but proportional to the displacement 
will attempt to pull the spring back; the subsequent motion of an object of 
mass m attached to the end of the spring is described by Newton's laws of 
motion: 

my — —ky (25.1) 

where k is a positive constant that is determined by the mechanical prop- 
erties of the spring. The right-hand side of quation (25.1) - that the force 
is proportional to the displacement - is known as Hooke's Law. 

Simple Harmonic Motion 

Rearranging equation (25.1), 

y" + io 2 y = 0 (25.2) 

where to = \Jkjm is called the oscillation frequency. Equation (25.2) 
is called the simple harmonic oscillator equation because there are no 
additional drag or forcing functions. The oscillator, once started, continues 
to oscillate forever in this model. There are no physical realizations of 
(25.2) in nature because there is always some amount of drag. To keep a 
spring moving we need to add a motor. Before we see how to describe drag 
and forcing functions we will study the simple oscillator. 
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The characteristic equation is r 2 + lo 2 = 0, and since the roots are purely 
imaginary (r = ±zw) the motion is oscillatory, 

y = Ci cos Lot + Ci sin Lot (25.3) 

It is sometimes easier to work with a single trig function then with two. To 
do this we start by defining the parameter 

A 2 = Cl + Cl (25.4) 

A, and define the angle (f> such 

(25.5) 
(25.6) 

We know such an angle exists because 0 < \C\ \ < A and 0 < | C2 1 < A and 
by (25.4) cj> satisfies the identity cos^ + sin 2 (f> — 1 as required. Thus 

y = A cos 4> cos Lot — A sin <f> sin Lot (25.7) 
= Acos{cj) + Lot) (25.8) 

Then cj) = tan _1 (Ci/C2) is known as the phase of the oscillations and A 
is called the amplitude. As we see, the oscillation is described by a single 
sine wave of magnitude (height) A and phase shift (j>. With a suitable re- 
definition of Ci and C2, we could have made the cos into sin rather than a 
cosine, e.g., C\/A — sin0 and C2/phi = coscj). 

Damped Harmonic Model 

In fact, equation (25.2) is not such a good model because it predicts the 
system will oscillate indefinitely, and not slowly damp out to zero. A good 
approximation to the damping is a force that acts linearly against the mo- 
tion: the faster the mass moves, the stronger the damping force. Its direc- 
tion is negative, since it acts against the velocity y' of the mass. Thus we 
modify equation (25.2) to the following 

my" = -Cy' - ky (25.9) 

where C > 0 is a damping constant that takes into account a force that 
is proportional to the velocity but acts in the opposite direction to the 
velocity. 



where we chose the positive square root for 
that 

cos m = — - 
A 

■ a ° 2 
sm 0 = — 

A 
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It is standard to define a new constant b = C/m and a frequency u) = \ fkfm 
as before so that we can rearrange our equation into standard form as 

y" + by' +uj 2 y = 0 (25.10) 

Equation (25.10) is the standard equation of damped harmonic motion. 

As before, it is a linear second order equation with constant coefficients, so 
we can solve it exactly by finding the roots of the characteristic equation 

r 2 + br + uj 2 = 0 (25.11) 

The roots of the characteristic equation are given by the quadratic equation 
as 

-b ± V& 2 - 4w 2 
r = V — (25.12) 

The resulting system is said to be 

• underdamped when b < 2uj; 

• critically damped when b = 2lu; and 

• overdamped when b > 2oj. 

In the underdamped system (b < 2uj) the roots are a complex conjugate 
pair with negative real part, r = )i ± ivj where 



^ = 6/2>0, zu = uyjl - (6/2w) 2 (25.13) 

and hence the resulting oscillations are described by decaying oscillations 

y = Ae~ fit sm(wt + (f)) (25.14) 

The critically damped system has a single positive real repeated root r = 
fi = b/2 , so that 

y = (Ci + C 2 t)e-^ (25.15) 

The critically damped systems decays directly to zero without crossing the 
y-axis. 

The overdamped system has two negative real roots — /x± (where \w\ < 
/j) and hence 

y = e -t lt (Cie |ro|t + C 2 e- |ro| *) (25.16) 

The system damps to zero without oscillations, but may cross the y-axis 
once. The first term in parenthesis in (25.16) does not give an exponential 
increase because \zu\ < /i. 
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Figure 25.1: Harmonic oscillations with w = 1 and initial conditions y(0) — 
1, y'(0) = 0. (a) simple harmonic motion; (b) under-damped system with 
b = 0.25; (c) critically damped system with b — 2.0; (d) under-damped 
system with b = 0.025. 




Forced Oscillations 

Finally it is possible to imaging adding a motor to the spring that produces 
a force f(t). The resulting is system, including damping, called the forced 
harmonic oscillator: 

my" = -Cy" - ky + f(t) (25.17) 

If we define a force per unit mass F(t) = f(t)/m and uj and the parameter 
b as before, this becomes, in standard form, 

y" + by' + co 2 y = F(t) (25.18) 

This is the general second-order linear equation with constant coefficients 
that are positive. Thus any second order linear differential equation with 
positive constant coefficients describes a harmonic oscillator of some sort. 
The particular solution is 

y P = e r2t ( eS ri - T ^ u [ e- T ' lS F{s)ds (25.19) 



where n and are the roots of the characteristic equation. For example, 
suppose the system driven by a force function 

F(t)=F a sinat (25.20) 

Then 

y P =F 0 e r2t [ e {ri - r2)u [ e- riS sin as dsdu (25.21) 

Jt Ju 

= 2 F ° 2 e r2t I e-' r2U (a cos au + ri sin au)du (25.22) 
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As with the unforced case, we can define the amplitude and phase angle by 

Asin0 = -a{r 1 + r 2 ) (25.23) 
Acos8 = a 2 - r x r 2 (25.24) 



Then 



where 



F o Asin(at + 0) 



A 2 = [-a(n + r 2 )] 2 + [a 2 - r x r 2 \ 2 (25.26) 
= a 2 b 2 + (a 2 - uj 2 ) 2 (25.27) 

because r± + r 2 = — b and rir 2 = to 2 . Furthermore, 

(a 2 + r 2 )(a 2 +r 2 ) = a 4 + (r 2 + r 2 )a 2 + ( ri r 2 ) 2 g) 

and therefore 

= fo^ + g) ( 2Q) 

v/a^ 2 + (a 2 - cj 2 ) 2 

Forcing the oscillator pumps energy into the system; it has a maximum 
at a = uj, which is unbounded (infinite) in the absence of damping. This 
phenomenon - that the magnitude of the oscillations is maximized when 
the system is driven at its natural frequency - is known as resonance. If 
there is any damping at all the homogeneous solutions decay to zero and 
all that remains is the particular solution - so the resulting system will 
eventually be strongly dominated by (25.29), oscillating in synch with the 
driver. If there is no damping (6 = 0) then 

y = CM^ + i>) + F0 ^ at t 9) (25-30) 



where C is the natural magnitude of the system, determined by its initial 
conditions. 
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Figure 25.2: The amplitude of oscillations as a function of the frequency 
of the forcing function, a, as given by (25.29), is shown for various values 
of the damping coefficient 6 = 1, 0.3, 0.1, 0.03, 0.01 (bottom to top) with 
u> = l.The oscillations resonate as a — > uj. 




Frequency a of Forcing Function 



Lesson 26 



General Existence 
Theory* 

In this section we will show that convergence of Picard Iteration is the 
equivalent of finding the fixed point of an operator in a general linear vector 
space. This allows us to expand the scope of the existence theorem to initial 
value problems involving differential equations of any order as well systems 
of differential equations. This section is somewhat more theoretical and 
may be skipped without any loss of continuity in the notes. 

Before we look at fixed points of operators we will first review the concept 
of fixed points of functions. 

Definition 26.1. Fixed Point of a Function. Let /:R^1. A number 
a G E is called a fixed point of / if /(a) = a. 

Example 26.1. Find the fixed points of the function f(x) = x 4 + 2x 2 + 
x — 3. 

x = x 4 + 2x 2 +x-3 
0 = x 4 + 2x 2 - 3 
= (x - l)(x + \){x 2 + 3) 

Hence the real fixed points are x — 1 and x = — 1. □ 

A function / : K i-> R has a fixed point if and only if its graph intersects 
with the line y = x. If there are multiple intersections, then there are 
multiple fixed points. Consequently a sufficient condition is that the range 
of / is contained in its domain (see figure 26.1). 
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Figure 26.1: A sufficient condition for a bounded continuous function to 
have a fixed point is that the range be a subset of the domain. A fixed 
point occurs whenever the curve of f(t) intersects the line y = t. 




a b 



Theorem 26.2 (Sufficient condition for fixed point). Suppose that 
f(t) is a continuous function that maps its domain into a subset of itself, 
i.e., 

f(t) : [a, b] H> S C [a, b] (26.1) 
Then f(t) has a fixed point in [a, b]. 

Proof. If f(a) — a or f(b) = b then there is a fixed point at either a or b. 
So assume that both /(a) ^ a and /(&) ^ b. By assumption, f{t) : [a,b] >-> 
S C [a, b], so that 

f{a) > a and f(b) < b (26.2) 
Since both f(a) ^ a and f(b) ^ b, this means that 

f{a) > a and f(b) < b (26.3) 

Let g(t) — f(t) — t. Then g is continuous because / is continuous, and 
furthermore, 

g(a) = f(a) - a > 0 (26.4) 
g(b) = f(b) - b < 0 (26.5) 

Hence by the intermediate value theorem, g has a root r € (a, b), where 
g(r) = 0. Then 

0 = 9(r) = f(r) - r =^ f(r) = r (26.6) 

i.e., r is a fixed point of /. □ 
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In the case just proven, there may be multiple fixed points. If the derivative 
is sufficiently bounded then there will be a unique fixed point. 

Theorem 26.3 (Condition for a unique fixed point). Let / be a 

continuous function on [a, b] such that / : [a, b] i-> S C (a, b), and suppose 
further that there exists some postive constant K < 1 such that 



\f'(t)\<K, VtG[a,6] 
Then / has a unique fixed point in [a, b]. 



(26.7) 



Proof. By theorem 26.2 a fixed point exists. Call it p, 

V = f(p) (26.8) 
Suppose that a second fixed point g€ [a,b], q =^ p also exists, so that 

q = /(g) (26.9) 

Hence 

\f(p)-f(q)\=\p-q\ (26.10) 
By the mean value theorem there is some number c between p and q such 

M - /(«) 



that 



/'(c) = 



P 



Taking absolute values, 



/(P) - /(<?) 



= |/'(c)| <#<1 



(26.11) 



(26.12) 



and thence 

\f(p)-f(q)\<\p-q\ (26.13) 
This contradicts equation 26.10. Hence our assumption that a second, 
different fixed point exists must be incorrect. Hence the fixed point is 
unique. □ 

Theorem 26.4 (Fixed Point Iteration Theorem). Let / be as defined 
in theorem 26.3, and pq G (a, b). Then the sequence of numbers 



Pi = /(Po) 
P2 = /(pi) 

~>n = /(Pn-1 



(26.14) 



converges to the unique fixed point of / in (a, b). 
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Proof. We know from theorem 26.3 that a unique fixed point p exists. We 
need to show that pi — > p as i — > oo. 

Since / maps onto a subset of itself, every point Pi € [a,b]. 

Further, since p itself is a fixed point, p = f(p) and for each i, since pi = 
fipi-i), we have 



|Pi-p| = |ft-/(p)| = |/(Pi-i)-/(p)| 



(26.15) 



If for any value of i we have pi = p then we have reached the fixed point 
and the theorem is proved. 

So we assume that Pi ^ p for all i. 

Then by the mean value theorem, for each value of i there exists a number 
Cj between pi-\ and p such that 



!/(?,_!) - f(p)\ = l/'CcOHft-i -p\ < K\ Pl ^-p\ 



(26.16) 



where the last inequality follows because /' is bounded by K < 1 (sec 
equation 26.7). 

Substituting equation 26.15 into equation 26.16, 



\Pi-p\ = l/Cft-i) - f(p)\ < K\ Pl ^ -p\ 
Restating the same result with i replaced by i — 1, i — 2, . . 

\ Pi -i-p\ - \fipi-2) - f(p)\ < K\ Pl _ 2 ~p\ \ 
\Pi-2~p\ - \f(Pi-s) - f(p)\ < K\ Pi . 3 -p\ 

\Pi-3~P\ = \f(Pi-i) - f(p) \ < K\pi-4-p\ 

\p2-p\ = \f(pi)-f(p)\<K\ Pl -p\ 
\pi-p\ = \f(po)-f(p)\<K\p 0 -p\ 

Putting all these together, 

\ Pi -p\ <K 2 \ Pi _ 2 -p\ <K 3 \ Pl _ 2 -p\ <■■■< K*\po-p\ 

Since 0 < K < 1, 

0 < lim \pi -p\< \p 0 - p\ lim K l = 0 

i— voo i— j-oo 

Thus Pi — > p as i — > oo. 



(26.17) 



(26.18) 



(26.19) 

(26.20) 
□ 
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Theorem 26.5. Under the same conditions as theorem 26.4 except that 
the condition of equation 26.7 is replaced with the following condition: 
f(t) is Lipshitz with Lipshitz constant K < 1. Then fixed point iteration 
converges. 

Proof. Lipshitz gives equation 26.16. The rest of the the proof follows as 
before. □ 

The Lipshitz condition can be generalized to apply to functions on a vector 
space. 

Definition 26.6. Lipshitz Condition on a Vector Space. Let V be a 

vector space and let i £ I. Then f(t,y) is Lipshitz if there exists a real 
constant K such that 



for all vectors y, z € V. 

Definition 26.7. Let V be a normed vector space, S C V. A contraction 

is any mapping T : S t— > V such that 



where 0 < K < 1, holds for all y,z e S. We will call the number K 
the contraction constant. Observe that a contraction is analogous to a 
Lipshitz condition on operators with K < 1. 

We will need the following two results from analysis: 

1. A Cauchy Sequence is a sequence yo, j/i, . . . of vectors in V such 
that \\v m — v n \\ — > 0 as n,m — > oo. 

2. Complete Vector Field. If every Cauchy Sequence converges to an 
element of V, then we call V complete. 

The following lemma plays the same role for contractions that Lemma (12.6) 
did for functions. 

Lemma 26.8. Let T be a contraction on a complete normed vector space 
V with contraction constant K. Then for any ye V 



\f(t,y)-f(t,z)\<K\y,z\ 



(26.21) 



\\Ty-Tz\\<K\\y-z\\ 



(26.22) 



\\T n y-y\\ < 



1 - K 



n 



\\Ty-y\ 



(26.23) 



1 -K 
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Proof. Use induction. For n = 1, the formula gives 

\\Ty - y\\ < \^\\Ty - y\\ = \\Ty - y\\ (26.24) 

which is true. 

For n > 1 suppose that equation 26.23 holds. Then 

\\T n+1 y - y\\ = \\T n+1 y - T n y + T n y - y\\ (26.25) 

< ||T n+1 y - T n y\\ + \\T n y - y\\ (triangle ineqality) (26.26) 

1 — K n 

< || T n+i y _ T n yll + ___\\Ty _ y \\ (by ^6.23)) (26.27) 

= \\T n Ty-T n y\\ + ±^\\Ty-y\\ (26.28) 
1 - K " 

< K n \\Ty — y\\ H \\Ty — y|| (because T is a contraction) 

1 — 

(26.29) 

(1 - K)K n + (1 - X") 



1 - K 
1 - if n+1 



||r y -i/|| (26.30) 



Ty-y\\ (26.31) 



1 - K 

which proves the conjecture for n + 1. □ 

Definition 26.9. Let V be a vector space let T be an operator on V. Then 
we say y is a fixed point of T if Ty = y. 

Note that in the vector space of functions, since the vectors are functions, 
the fixed point is a function. 

Theorem 26.10. Contraction Mapping Theorem 1 Let T be a con- 
traction on a normed vector space V. Then T has a unique fixed point 
U G V such that Tu = u. Furthermore, any sequence of vectors V\,V2, ■ ■ ■ 
defined by Vk = Tvk-i converges to the unique fixed point Tu — u. We 
denote this by Vk — > u. 

Proof. 2 Let e > 0 be given and let v € V. 



lr The contraction mapping theorem is sometimes called the Banach Fixed Point The- 



orem. 

2 



The proof follows "Proof of Banach Fixed Point Theorem," Encyclopedia of Math- 
ematics (Volume 2, 54A20:2034), PlanetMath.org. 



223 



Since K n /(\ — K) — > 0 as n — > oo (because T is a contraction, K < 1) 
given any v € V, it is possible to choose an integer TV such that 



< e 



1 -K 

for all n > N. Pick any such integer N. 

Choose any two integers m > n > N , and define the sequence 



V 0 =V 

Vi = Tv 
v 2 = Tv\ 



v n = Tv n _ x 



Then since T is a contraction, 

\\v m -v n \\ = \\T m v-T n v\\ 

= \\T n T m - n v - T n v\ 
< K n \\T m - n v - v\\ 

From Lemma 26.8 we have 

1 — J^rn—n 



IK-Wn|| <K n 



1 - K 
K n — K 



< 



I - K 



-\\Tv — v\\ 
Tv — v\\ 



1 - K 



\Tv — v\\ < e 



(26.32) 



(26.33) 



(26.34) 
(26.35) 
(26.36) 



(26.37) 
(26.38) 
(26.39) 



Therefore v n is a Cauchy sequence, and every Cauchy sequence on a com- 
plete normed vector space converges. Hence v n — > u for some u € V. 

Either u is a fixed point of T or it is not a fixed point of T. 

Suppose that u is not a fixed point of T. Then Tu ^ u and hence there 
exists some 6 > 0 such that 



\Tu — u\\ > S 



(26.40) 



On the other hand, because v n — ¥ u, there exists an integer TV such that 
for all n > N, 

\\v n - u\\ < 8/2 (26.41) 
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Hence 

\\Tu - u\\ <\\Tu- v n+1 \\ + \\v n+1 - u\\ (26.42) 
= \\Tu-Tv n \\ + \\u-v n+1 \\ (26.43) 

< K\\u — v n \\ + \\u — v n+ \\\ (because T is a contraction) 

(26.44) 

< \\u — v n \\ + \\u — u n +i|| (because K < 1) 

(26.45) 

= 2||u-«„|| (26.46) 

< S (26.47) 

This is a contradiction. Hence u must be a fixed point of T. 

To prove uniqueness, suppose that there is another fixed point w ^ u. 

Then ||u) — u\\ > 0 (otherwise they are equal). But 

||u - u;|| = \\Tu - Tw\\ < K\\u - w\\ < \\u - iu|| (26.48) 

which is impossible and hence and contradiction. 

Thus u is the unique fixed point of T. □ 

Theorem 26.11. Fundamental Existence Theorem. Let D E M 2 be 

convex and suppose that / is continuously differentiable on D. Then the 
initial value problem 

y' = f(t,y), y(t 0 ) = y 0 (26.49) 
has a unique solution <j)(t) in the sense that <fr'(t) = fit, 4>{y)), 4>{to) = yo- 

Proof. We begin by observing that ^ is a solution of equation 26.49 if and 
only if it is a solution of 

4>(t)=y 0 + f f(x,<t>(x))dx (26.50) 
Jt„ 

Our goal will be to prove 26.50. 

Let V be the set of all continuous integrable functions on an interval (a, b) 
that contains to. Then V is a complete normed vector space with the sup- 
norm as norm, as we have already seen, mn 

Define the linear operator T on V by 

T(<p)=y 0 + f f(s,<p(s))ds (26.51) 

Jt 0 
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for any cj> 6 V. 

Let g, /i be functions in V. 



\Tg-Th\\ 



sup \Tg — Th\ 

a<t<b 



sup 

a<t<b 



sup 

a<t<b 



JJa + / f(x,g(x))dx - y a 



[f(x,g{x)) -f(x,h(x))] dx 



(26.52) 

f(x, h(x))dx 

(26.53) 
(26.54) 



Since / is continuously differentiablc it is diffcrentiable and its derivative 
is continuous. Thus the derivative is bounded (otherwise it could not be 
continuous on all of (a, b)). Therefore by theorem 12.3, it is Lipshitz in its 
second argument. Consequently there is some K 6 E such that 



\\Tg — Th\\oo < L sup / \g(x) — h(x)\ dx 

a<t<b Jtn 



to 

<K{t-t 0 ) sup \g(x))-h(x)\ 

a<t<b 

<K(b-a) sup \g(x))-h(x)\ 

a<t<b 



(26.55) 
(26.56) 
(26.57) 
(26.58) 



<K(b-a)\\g-h\\ 
Since K is fixed, so long as the interval (a, b) is larger than l/K we have 
WTg-ThWooKK'Wg-hWoo (26.59) 

where 



K' = K(b - a) < 1 



(26.60) 



Thus T is a contraction. By the contraction mapping theorem it has a fixed 
point; call this point <fi- Equation 26.50 follows immediately. □ 

This theorem means that higher order initial value problems also have 
unique solutions. Why is this? Because any higher order differential equa- 
tion can be converted to a system of equations, as in the following example. 

Example 26.2. Convert initial value problem 

y" + 4iV+y 3 = sin(t)' 



2/(0) = 1 
1/(0) = 1 



(26.61) 



226 



LESSON 26. GENERAL EXISTENCE THEORY 



to a system. 

We create a system by defining the variables 

xi = y 

%2 = y' 



(26.62) 



Then the differential equation becomes 

x 2 + At 3 x 2 + x 3 = sin t (26.63) 

which we can rewrite as 

x' 2 = sin t-xf- At 3 x 2 (26.64) 
We then define functions /, and g, 

f(xi, x 2 ) = sint — x\ — At 3 x 2 



g(x 1 ,x 2 ) = x 2 
so that our system can be written as 



with initial condition 



'A = f(x 1 ,x 2 ) 

A = g{x 1 ,x 2 ) 



xi (0) = 1 
x 2 (0) = 1 



(26.65) 



(26.66) 



(26.67) 



It is common to define a vector x = (xi,x 2 ) and a vector function 

F(x) = (f(x 1 ,x 2 ),g(x 1 ,x 2 )) (26.68) 
Then we have a vector initial value problem 

x'(t) =F(x) = (smt - xf - U 3 x 2 ,x 2 )\ 



x(0) = (l,l) 



(26.69) 



Since the set of all differentiable functions on K 2 is a vector space, our 
theorem on vector spaces applies. Even though we proved theorem (26.50) 
for first order equations every step in the proof still works when y and / 
become vectors. On any closed rectangle surrounding the initial condition 
F and dF/dxi is bounded, continuous, and differentiable. So there is a 
unique solution to this initial value problem. □ 
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Higher Order Linear 
Equations 



Constant Coefficients and the Linear Operator 

Generalizing the previous sections we can write the general nth-order linear 
equation with constant coefficients as 

a n yW + a n ^ n - 1 '> + ■■■ + a lV ' + a 0 y = f(t) (27.1) 

The corresponding characteristic polynomial is 

P n (r) = a n r n + a n - X r n ~ x + ■ ■ ■ + a 0 (27.2) 
= a n (r - ri )(r - r 2 ) ■ ■ ■ (r - r n ) (27.3) 
= 0 (27.4) 

and the corresponding n-th order linear operator is 

L n = a n D n + a^D 11 - 1 + ■ ■ ■ + a 0 (27.5) 
= a n (D- ri )(D-r 2 )---(D-r n ) (27.6) 



where ao,...,a n € K are constants and T\,ri, ...,r n G C are the roots of 
Pn{r) = 0 (some or all of which may be repeated). The corresponding 
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initial value problem is 



L n y = f(t)) 

y(to) = vo 
y'{t 0 ) = yi 



y {n) (t 0 )=y n J 



(27.7) 



where yo, ■■■,y n G M are constants. 

While the roots of P n (r) = 0 may be complex we will restrict the coefficients 
and initial conditions to be real. The linear operator has the following 
properties: 



L n (y) = P n {D)y 
L n (e rt ) = e rt P n (r) 
L n (e rt y) = e rt P n (D + r)y 



(27.8) 
(27.9) 
(27.10) 



Equations (27.8) and (27.9) are straightforward; (27.10) can be proven by 
induction. 

Proof of (27.10) by induction (inductive step only).* Assume L n (e rt y) = 
e rt P n (D + a). Then 

L n+1 (e rt y) = a n+1 (D - n) ••■(£> - r n+1 )e rt y (27.11) 
= (D-r 1 )z (27.12) 



where 



* - a n+1 (D - r 2 )(D - r a ) •••(£>- r n+1 )(e rt y) 



(27.13) 



Since (27.12) is an nth order equation, the inductive hypothesis holds for 
it, namely, that 

z = e rt a n+1 (D + r - r 2 )(D + r - r 3 ) •••(£> + r - r n+1 )y = e rt u (27.14) 



where 



u = a n+ i(D + r - r 2 ) ■ ■ ■ (D + r - r n+1 )y 



(27.15) 



Substituting, 

L n+1 (e rt y) = (D- ri )z=(D- ri )e rt u 

= re u + e u — r%e u 

= e rt (D + r- ri )u 

Substituting back for u from (27.15) and applying the definition of P n +\{x) 



(27.16) 
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L n+1 {e rt y) = e rt a n (D + r-r 1 ){D + r-r 2 )---(D + r~r n+1 )y 
= e rt P n+1 (D + r)y 

(27.17) 

which proves the assertion for n+ 1, completing the inductive proof. □. 
The general solution to (27.1) is 

y = y H + yp (27.18) 

where 

Vh = C iyH ,i + C 2 Vh,i + ■■■ + C n y H . n (27.19) 

and the yn. i are linearly independent solutions of the homogeneous equation 
L n y — 0. If L is n-th order then there will be n linearly independent 
solutions; taken together, any set of n linearly independent solutions are 
called a fundamental set of solutions. Note that the set is not unique, 
because if y is a solution the differential equation then so is cy for any 
constant c. 

Superposition and Subtraction 

As before with second order equations, we have a principle of superposition 
and a subtraction principle. 

Theorem 27.1. (Principle of Superposition.) If u(t) and v(t) are any two 
solutions of L n y = 0 then any linear combination w(t) = c\u(t) + C2v(t) is 
also a solution of L n y = 0. 

Theorem 27.2. (Subtraction Principle)If u(t) and v(t) are any solutions 
to L n y — f(t) then w(t) = u(t) — v(t) is a solution to the homogeneous 
equation L n y = 0. 
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The Homogeneous Equation 

The solutions we found for second order equations generalize to higher or- 
der equations. In fact, the solutions to the homogeneous equation are the 
functions e rt , te rt ,..., t k ~ 1 e rt where each r is a root of P n { r ) with multi- 
plicity fc, and these are the only solutions to the homogeneous equation, as 
we prove in the following two theorems. 

Theorem 27.3. Let r be a root of P n ( r ) with multiplicity fc. Then 
e rt ,te rt , ...,t e rt are solutions to the homogeneous equation L n y = 0. 

Proof. Since r is a root of P n (r), then P n {r) — 0. Hence 

L n e rt = e rt P n (r) = 0 (27.20) 

Suppose that r has multiplicity fc. Renumber the roots n, T2, r n as 
ri,r 2 ,...,r n _fc,r, ...,r. Then 

k times 

P n (x) = a n (x - n)(x - r 2 ) ■ ■ ■ (x - r n _ k )(x - r) k (27.21) 

Let s E {0, 1, 2, fc— 1} so that s < fc is an integer. Then by the polynomial 
shift property (27.10) and equation (27.21) 

L n (e rt t s ) = e rt P n (D + r)t s 

because D k (t s ) = 0 for any integer s < fc. □ 

Theorem 27.4. Suppose that the roots of P n (r) = a n r n + a„_ir n_1 + 
■ • • + do are r± , r/s with multiplicities m\ , TO2 , ■ ■ • , n^k (where mi + mi + 
• • • + = n). Then the general solution of L n y = 0 is 

k rrii — 1 

.</// X''''X f V'' (27-23) 

i=l j=0 

Before we prove theorem 27.3 will consider several examples 

Example 27.1. Find the general solution of y'" — 3y" + 3y' — y = 0 The 
characteristic equation is 

r 3 - 3r 2 + 3r - 1 = (r - i f = 0 (27.24) 

which has a single root r — 1 with multiplicity 3. The general solution is 
therefore 

y={C x + C 2 t + C 3 i 3 )e* □ (27.25) 
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Example 27.2. Find the general solution of ?/ 4 ) — 2y" + y = 0 

The characteristic equation is 



0 



2r 2 +r = (r 2 - l) 2 = (r - l) 2 (r + l) 2 



(27.26) 



The roots arc 1 and -1, each with multiplicity 2. Thus the solution is 

y = e\C 1 +C 2 t) + e- t {C- i + C 4 t) □ (27.27) 

Example 27.3. Find the general solution of ?/ 4 ) — y = 0 
The characteristic equation is 



0 



1 = (r 2 - l)(r 2 + 1) = (r - l)(r + l)(r - i)(r + i) (27.28) 



There are four distinct roots r = ±1, ±i. The real roots give solutions e ±l ] 
the complex roots r = 0 ± i give terms sini and cost. Hence the general 
solution is 

y = Cie* + C 2 e _t + C 3 cos i + C 4 sini □ 



(27.29) 



Example 27.4. Find the general solution of ?/ 4 ) + y = 0 
The characteristic equation is r 4 + 1 = 0. 
Therefore r = (— l) 1 / 4 . By Euler's equation, 

— 1 = e i7r = e i ( 7T + 2k7r ) 
hence the four fourth-roots are 



(-1) 



1/4 



exp 



i(ir + 2kir) 
4 

7r kir 



Therefore 



1 r 2 j ' ( i • 2 



v/2 >/2 1 
±^r" ± z^r" = -^-(±1 ± i) = — p= 
2 2 2 v \/2 



fc = 0,1,2,3 



(±l±i) 



(27.30) 

(27.31) 
(27.32) 

(27.33) 



and the general solution of the differential equation is 



y 



1 n 1 

Gi cos — = + G 2 sin — = 
y/2 V2 



+ e 



-t/y/2 



63 cos —= + 64 sin —= 
V2 V2 



□ 



(27.34) 
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To prove theorem 27. 3 1 we will need a generalization of the fundamental 
identity. We first define a the following norm of a function: 



i/(*)ii 2 = Ek (i) w 



(27.35) 



!/(*)! + !/'(*)! 



(n-1) 



(*) 



(27.36) 



That || • ■ ■ | defines a norm follows from the fact that for any two functions 
f(t) and g(t), and for and constant c, the following four properties are true 
for all t: 

Properties of a Norm of a Function: 

i- ll/WII >o 

2. ||/(i)||=0 & f(t) = 0 

3. ||/(*)+ff(<)||<||/(t)|| + ||s(t)|| 

4. ||c/(t)||<| C |||/(t)|| 

For comparison to the norm of a vector space, see definition 15.2 which is 
equivalent to this for the vector space of functions. 

Lemma 27.5. (Fundamental Identity for nth order equations) Let <p(t) be 
a solution of 

L n y = 0, y(t 0 ) = yo, ...,y^(t 0 ) = y n (27.37) 

then 

\Wo)\\ e-^'-'oli < U(t)\\ < \\<f>(t 0 )\\ e K ^-^ (27.38) 

for all t. 

Lemma 27.6. 2 \a\ \b\ < \a\ 2 + \b\ 2 



Proof. (\a\ 



|a| 2 + |6| 2 -2|a||6| > 0. □ 



Proof, (of Lemma 27.5.) We can assume that a n ^ 0; otherwise this would 
not be an nth-order equation. Further, we will assume that a n — 1; other- 
wise, redefine L n by division through by a n . 

Let 

n—l 2 n—l 

«(*) = II^WII 2 = E |^ w (*)| = E 4> {i) {t)^*{t) (27.39) 

i=0 i=0 



1 This material is somewhat more abstract and the reader may wish to skip ahead to 
the examples following the proofs. 
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Differentiating, 



d 



«'(*) = J t E = S E * ( W>*(*) (27-40) 



eft 



»=o i=0 
Taking the absolute value and applying the triangle inequality twice 



i«'(t)i < E |^ (<+1) (*)^ (<) *w + 0 (i) (t)^ (<+1) *(*) 

i=0 

Since |a| = |a*| 

n-l 

i«'(i)i<E 2 k (i+1) w ^ (<) (*) 



i=0 



(27.41) 



(27.42) 



Isolating the highest order term 



'(f) I < { E 2 k (<+1) (*) +2^ (n) (t) ^"-^(t) (27.43) 



Since L n <j>(t) = 0 and a n = 1, 



4> {n) (t) 



i=0 



n-l 



n-l 



i=0 



i=0 



Combining the last two results, 



i=0 



By lemma 2, 



Hence 



(i+l)( t ) 




H 


n-l 

E' a *i ' 

t=0 


00+1) 


0« < 


0(i+l) 


V 0« 



(27.45) 
(27.46) 



, i=0 



■'(«)!< E k (i+1) w + 



+2 



n-l 



(n-l) 



(t) E kl 



=0 



By a change of index in the first term (let j = i + 1) 

2 



e k 4+1) 

i=0 



= Er' } (*) 



(27.47) 



(27.48) 



234 



LESSON 27. HIGHER ORDER EQUATIONS 



n-2 



so that 

n-l 

i«'(*)i<£|* (i) (*)~ + £|* (i) (*) 

i=l i=0 

Since 



n-l 



£N<£|c* 



i=l 



i=0 



and 



£N<£|c* 

i=0 i=0 

for any set of numbers Cj, this becomes 



i=0 



n-l 



+2 



At)l<£^ w M + £k w (*) 

i=0 
n-l 



i=0 



i=Q 



From equation (27.39), 

n-l 

|«'(t)|<2«(t) + 2 ^"-^W^lflil 

From lemma 1, 
Therefore, 

n-l 

< 2u(t) + H 2u (t) 



det M ^ 0 



2u(t) 



! + £ 



i=0 



2Ku(t) 



Hence 



2K<^± <2K 
~ u(t) ~ 



Let u(to) = uq and integrate from to to i 



2K f ds< [ V 4 S lds <2K [ ds 
J to J u u \ s ) J to 



(27.49) 
(27.50) 

(27.51) 



(27.52) 

(27.53) 
(27.54) 

(27.55) 
(27.56) 

(27.57) 
(27.58) 
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Integrating, 



Exponentiating, 



2K\t-t 0 \ < In \u(t)/u{t 0 )\ < 2K\t-t 0 \ 



\u 0 (t)\e- 2K ^ < \u(t)\ < \u 0 (t)\e 2K ^- t0 



(27.59) 



(27.60) 



By equation (27.39) this last statement is equivalent to the desired result, 
which is the fundamental inequality. □ 



Proof. (Theorem 27.3) By the previous theorem, each term in the sum is a 
solution of L n y = 0, and hence by the superposition principle, (27.23) is a 
solution. 

To prove that it is the general solution we must show that every solution 
of L n y = 0 has the form (27.23). 

Suppose that u(t) is a solution that does not have the form given by (27.23), 
i.e., it is not a linear combination of the = e rit P . 

Renumber the y^- to have a single index yi,...,y n , and let uq = u(to),ui = 
u'(to), it n -i = u( n_1 )(i 0 )- Then u(t) is a solution of some initial value 
problem 



L n y = 0, y(t 0 ) = u 0 ,y'(t 0 ) =u 1 ,...,y ( - n 1) (i 0 )=M„_i 
and by uniqueness it must be the only solution of (27.61). Let 



v = cij/i + c 2 y 2 



Differentiating n times, 



v' =ciy[+ c 2 y' 2 



CnVn 



CnVn 



We ask whether there is a solution ci, c 2 , c„ to the system 

v(t 0 ) = ciyi(io) + C2V2{h) H h c n y n {t 0 ) = u 0 

If the matrix 



M = 



( Vi(to) 



Vi (to) 
3/2 (*o) 



Vn(to) \ 



(27.61) 



(27.62) 



(27.63) 



(27.64) 



(27.65) 
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is invertible, then a solution of (27.64) is 



c = M _1 u 0 



(27.66) 
T . But M is 



where c = (c% C2 ■ ■ ■ c„) T and uq — (uq u% ■ ■ ■ 
invertible if and only if det M ^ 0. We will prove this by contradiction. 

Suppose that det M = 0. Then Mc = 0 for some non-zero vector c, i.e, 



/ Vi (*o) 



2/2 (to) 

y' 2 (to) 



Vn(to) 

y' n (to) 



V y[ n - 1} (t 0 ) y^ 1] (to) 

and line by line, 



(n-l) 
Vn 



(to) J 





( C1 


\ 




C2 




) 







(27.67) 



v {j) (t 0 ) = J2c i y ( : j) (t 0 )=a, J=0,1,.. 



(27.68) 



Using the norm defined by (27.35), 



IK*o)ll 2 = £ « W) faO 



i=0 



By the fundamental inequality, since v(t) is a solution, 

||^(*o)]| e-^l*-*°l < ]|^(*)|| < ||^(*o)]| e^l*-*^! 



(27.69) 



(27.70) 



Hence ||i>(t)|| = 0, which means v(t) = 0 for all t. Since all of the yi(t) are 
linearly independent, this means that all of the Ci = 0, i.e., c = 0. But this 
contradicts (27.67), so it must be true that detM ^ 0. 

Since detM ^ 0, the solution given by (27.66) exists. Thus v(t), which ex- 
ists as a linear combination of the yi is a solution of the same initial value 
problem as u(t). Thus v(t) and u(t) must be identical by uniqueness, and 
our assumptions that u(t) was not a linear combination of the t/j is contra- 
dicted. This must mean that no such solution exists, and every solution of 
L n y = 0 must be a linear combination of the yi. □ 



The Particular Solution 



The particular solution can be found by the method of undetermined coef- 
ficients or annihilators, or by a generalization of the expression that gives 
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a closed form expression for a particular solution to L n y = /(<). Such an 
expression can be found by factoring the differential equation as 

L n y = a n {D - n ){D - r 2 ) •••(£> - r n )y (27.71) 
= a n {D - n)z = fit) (27.72) 

where z = (D — r 2 ) •••(£> — r n )y. Then 

z' - nz = (l/o»)/(t) (27.73) 

An integrating factor is fi = e~ Tlt , so that 

(D - r 2 ) ■■■(D - r n )y = z (27.74) 

= — e rii / e-'' lSl /(si)^i = /i(t) (27.75) 

where the last expression on the right hand side of (27.74) is taken as the 
definition of fi(t). We have ignored the constants of integration because 
they will give us the homogeneous solutions. 

Defining a new z = (D — r^) ■••(£) — r n )y gives 

z'-r 2 z = f 1 (t) (27.76) 
An integrating factor for (27.76) is /i = e~ r2t , so that 

(D - r 3 ) • • • (D - r n )y = z = e r > 1 J ^- n - s \h{s 2 )ds 2 = f 2 (t) (27.77) 

where the expression on the right hand side of (27.77) is taken as the 
definition of f 2 (t). Substituting for /i(s 2 ) from (27.74) into (27.77) gives 

(D-r 3 )---(D- r n )y = e r * [ e ~ r ^—e r ^ [ e~ r ^ f( Sl )d Sl ds 2 

(27.78) 

Repeating this procedure n times until we have exhausted all of the roots, 



e r n t 

VP = — 
a n j 

-J 


f e (r n -i-r n )s, 
e (ri-r 2 )s 2 

S3 ^ 


f 

S2 


1 e (r„- 2 -r„- 1 )s n - 1 , , _ 

e- riSl f( Sl )d Sl ---ds n 



(27.79) 



□ 
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Example 27.5. Find the general solution to y'" + y" — 6y' = e*. 

The characteristic equation is 

0 = r 3 +r 2 -6r = r(r-2)(r + 3) (27.80) 

which has roots r\ — 0, r 2 — 2, and r 3 — —3. The general solution to the 
homogeneous equation is 

y„ = d + C 2 e 2t + C 3 e- 3t (27.81) 

From (27.79), a particular solution is 

y P = e r3t f e ^- r3)sa f e (ri ~ r ^ f e~ r ^ f{ Sl )d Sl d S2 ds 3 (27.82) 

J t J S3 J S2 

3t I „5s3 / _— 2s 



e- n / e 0S3 / e' ZS2 / e Sl d Sl ds 2 ds 3 (27.83) 

J t J S3 J S2 

e -st /* e 5 S3 /* e -2^ eS2ds2ds3 (27.84) 



«3 



e" 3t / e 5s3 / e- S2 ds 2 ds 3 (27.85) 



S3 



-e~ il J e bS3 e- S3 ds 3 (27.86) 

-e~ 3t £e iS3 ds 3 (27.87) 

-^e- 3t e 4 * (27.88) 

4 e * ( 27 - 89 ) 



Hence the general solution is 

V = VP + Vh = -~e* + d + C 2 e 2t + C 3 e- 3 * (27.90) 

In general it is easier to use undetermined coefficients to determine yp 
if a good guess for its form is known, rather than keeping track of the 
integrals in (27.79). Failing that the bookkeeping still tends to be easier if 
we reproduce the derivation of (27.79) by factoring the equation one root 
at a time than it is to use (27.79) directly. In general the best "guess" for 
the form of a particular solution is the same for higher order equations as 
it is for second order equations. For example, in the previous example we 
would have looked for a solution of the form y P = ce*. 
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Example 27.6. Find the general solution of z/ 4 ' — 5y" + 4y = t 

The characteristic equation is 0 = r 4 — 5r 2 + 4 = (r 2 — l)(r 2 — 4) so the 
roots are 1, -1, 2, and -2, and the homogeneous solution is 

y H = Cie* + C 2 e- 4 + C 3 e 2t + Qe" 24 (27.91) 

Using the factorization method: we write the differential equation as 

(D - l)(D + 1)(D- 2){D + 2)y = {D-l)z = t (27.92) 

where z = (D + i)(D — 2)(D + 2)y. Then z' — z = t. An integrating factor 
is e _t , so that 



; J te^dt = e* [-(t + l)e -t ] = -t - 1 



(27.93) 



where we have ignored the constant of integration because we know that 
they will lead to the homogeneous solutions. Therefore 



= {D + !)(£> - 2)(D + 2)j/ = (D + l)tB = -t - 1 



(27.94) 



where w = (D — 2)(D + 2)y. Equation (27.94) is equivalent to w' + w = 
— t — 1, so that 



e*(t+ l)d* 



-e"* [(t-i) e * + e*] 
-t 



(27.95) 

(27.96) 

(27.97) 
(27.98) 



Therefore 



w = (D-2)(D + 2)y 
= (D- 2)u = -t 



,21 



te~ 2t dt 



-.2/ 



1 1 

"2*- 4 



-2* 



1 1 

2* + 4 



Therefore 



l/+2 W =j(2t + l) 



(27.99) 
(27.100) 



where u = (D + 2)y = y' + 2y. Equation (27.99) is u' - 2u = -t. An 
integrating factor is e~ 2t and the solution for u is 



(27.101) 
(27.102) 
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An integrating factor is e 2t so that 



y=\e- 2t [ e 2t (2t+l)dt 



4 
1 

4 ( 

t 

4 



2 / te 2t dt + I e 2t dt 



(27.103) 
(27.104) 
(27.105) 
(27.106) 



Therefore yp = i/4. 

Alternatively, using the method of undetermined coefficients, we try yp — 
ct in the differential equation j/ 4 ) — by" + 4y = t. Since y' = c and y" = 
y^ =0wc find 4ci = t or c = 1/4, again giving yp = t/4. 

Hence the general solution is 

1 



V = VP + yn = ^t + de* + C 2 e 1 + C 3 e 2 



C 4 e" 



□ (27.107) 



We also have an addition theorem for higher order equations. 

Theorem 27.7. If yp^, i = 1, 2, k are particular solutions of L n yp,i = 
fi(t) then 

yp = yp.i+yp,2 + --- + ypM (27.108) 

is a particular solution of 

L n y = fi{t) + h(t) + ■■■ + f k {t) (27.109) 
Example 27.7. Find the general solution of y'" - Ay 1 = t + 3 cos t + e~ 2t . 
The general solution is 



V = Vh + y\ + 2/2 + 2/3 



(27.110) 



where 



Vh - ±y' H = 0 
2/i"-42/i=i 

V 2 = 3 cost 
^'-V 3 = e- 2t 



(27.111) 
(27.112) 
(27.113) 
(27.114) 
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The characteristic equation is 

0 = r 3 - 4r = r(r 2 - 4) = r(r - 2)(r + 2) (27.115) 

Since the roots are r = 0, ±2, the solution of the homogeneous equation is 

i/ff = Ci + C 2 e 2t + C 3 e~ 2t (27.116) 

To find our first inclination would be to try y = At + B. But e ot is 
a solution of the homogeneous equation so we try y + 1 = i fe (at + 6) with 
k = 1. 

Vl =t k (a + bt)e ot = at + bt 2 (27.117) 
Differentiating three times 

y[ = a + 2bt (27.118) 

j/i = 26 (27.119) 

yi" = 0 (27.120) 

Substituting into the differential equation gives 

t = J,;" - 4j/i = 0 - 4(o + 2&t) = -4a - 86i (27.121) 

This must hold for all f, so equating like coefficients of t gives us a — 0 and 
b = — 1/8 so that the first particular solution is 

Vi = -\t 2 (27.122) 
For j/2, since r = ±i are not roots of the characteristic equation we try 

2/2 =acost + &sinf (27.123) 

Differentiating three times, 

2/2 = -asinf + 6cosi (27.124) 

2/2 = -acosi- bsmt (27.125) 

2/ 2 " = asint- 6cosi (27.126) 

Substituting into the differential equation for y 2 

3 cost — asint — 6 cost — 4(— asint + fecost) (27.127) 

= asint - ocost + 4a sin t - 46 cost (27.128) 

= 5asint- 56cost (27.129) 
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Equating coefficients gives a — 0 and b = -3/5, and hence 

3 

y 2 = --smt (27.130) 
5 

For j/3, Since r — — 2 is already a root of the characteristic equation with 
multiplicity one, we will try 

y 3 = ate- 2t (27.131) 
Differentiating three times gives 

y 3 = a (e~ 2t - 2ie" 2t ) (27.132) 

= ae- 2t (l-2t) (27.133) 

y' 3 ' = a [-2e- 2 *(l - 2t) + e- 2t (-2)] (27.134) 

= ae- 2 *(-4 + 4f) (27.135) 

y 3 " = a [-2e- 2t (-4 + At) + e- 2t (4)] (27.136) 

= ae- 2t {\2-U) (27.137) 

Substituting for y 3 into its ODE gives 

e - 2t = [ae~ 2t (12 - 8t)] - 4 [ag- 2 *(l - 2t)] = 8ae~ 2t (27.138) 

and therefore a = 1/8, so that 

y 3 = l -te~ 2t (27.139) 

Combining all of the particular solutions with the homogeneous solution 
gives us the general solution to the differential equation, which is given by 

y = C 1 +C 2 e 2t + C 3 e~ 2t -\t 2 -\sint+\te- 2t . □ (27.140) 

8 5 8 
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The Wronskian 



In this section we generalize the definition of Wronskian to higher order 
equations. If {yi, ■■■,yk} are any set of functions then we can form the 
matrix 



W[ yi ,...,y k ](t) 



( 2/i 
2/i 



2/2 

272 



Vk \ 

y'k ] 



\ (fc-i) (fe-i) 

\ 2/i Vi 



(fe-i) 
Vk 



(27.141) 



We use the square bracket notation [■ ■ ■ ] above to indicate that W depends 
on a set of functions enclosed by the bracket, and the usual parenthesis 
notation (• ■ ■ ) to indicate that W depends on a single independent variable 
t. When it is clear from the context what we mean we will omit the [• • • ] 
and write W(f) where we mean (implicitly) W[- • - ](t). 

Denote the general nth order linear differential equation by 

L n y = a„(t)y (n) + a n - X {t)y^ + ■■■ + ai (t)y' + a 0 (t)y = f(t) (27.142) 

and let {yi, y k } form a fundamental set of solutions to L n y = 0. Recall 
that j/i, . . . , yk form a fundamental set of solutions if they are linearly in- 
dependent and every other solution can be written as a linear combination. 
If the functions in the W matrix are a fundamental set of solutions to a 
differential equation then (27.141) is called the fundamental matrix of 
L n y = 0. 

The determinant of (27.141), regardless of whether the solutions form a 
fundamental set, is called the Wronskian, which we will denote by W(t). 



W[ yi ,...,y k ](t) = 



2/1 



Ilk 



(fc-i) o-i) 
2/i ••• Vk 



detW 



(27.143) 



Again, we will omit the square brackets [• • • ] and write the Wronskian as 
W(t) when the set of functions it depends on is clear as W(t). When the 
set of functions {yi, y k } form a fundamental set of solutions to L n y = 0 
we will call it the Wronskian of the differential equation. 

If we calculate the Wronskian of a set of functions that is not linearly inde- 
pendent, then one of the functions can be expressed as a linear combination 
of all other functions, and consequently, one of the columns of the matrix 
will be a linear combination of all the other columns. When this happens, 
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the determinant will be zero. Thus the Wronskian of a linearly dependent 
set of functions will always be zero. In fact, as we show in the following 
theorems, the Wronskian will be nonzero if and only if the functions form 
a complete set of solutions to the same differential equation. 

Example 27.8. Find the Wronskian of y'" - 4y' = 0. 

The characteristic equation is 0 = r — 4r = r(r 
a fundamental set of solutions are yi = 1, yi - 
Wronskian is 



-4) = r(r- 
3 2t , and 2/3 



2)(r + 2) and 
= e- 2t . Their 



W(t) 



JJ2 
0 2t 



2/1 

v'l 

1 e 

0 2e 2t 

0 4e 2t 

2e 2 ' - 
4e 



2/3 

2/3 
2/3' 
e -2t 

-2e- 2t 
Ae -2t 

2e- 2t 



21 



4e- 



-it 



= 16. 



□ 



(27.144) 

(27.145) 
(27.146) 



Example 27.9. Find the Wronskian of y" 



f + I6y' = 0. 



The characteristic equation is 0 



-8r 2 + 16r = r(r 2 -8r+16) = r(r-4) 2 



so a fundamental set of solutions is yi = 1, j/2 = e 4t and j/3 = te 4t . Therefore 



W(t) 



e 4t 
4e 4 * 
16e 4t 



ie 4t 
e 4t (l+4t) 
8e 4t (l + 2£) 



= (4e 4t )[8e 4t (l + 2t)] - [e 4t (l + 4f)](16e 4 ') 



16e 



8/ 



(27.147) 

(27.148) 
(27.149) 



Theorem 27.8. Suppose that y\, j/2, y n all satisfy the same higher 
order linear homogeneous differential equation L n y = 0 on (a, b) Then 
2/1)2/2, ■■■,y n form a fundamental set of solutions if and only if for some 
to e (a, 6), W[ yi ,...,y n }(t 0 ) ^ 0. 



Proof. Let j/i, y„ be solutions to L„y = 0, and suppose that VF[jyi, ...,y n ](t 0 
0 for some number to € (a, 6). 

We need to show that y\,-.,y n form a fundamental set of solutions. This 
means proving that any solution to L n y = 0 has the form 

<t>(t) = C m + C 2 y 2 + ■ ■ ■ + C n y n (27.150) 

Consider the initial value problem 

L n y = 0, y(t 0 )^y 0 ,...,y in - 1 \t 0 )^y n (27.151) 
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Certainly every cf)(t) given by (27.150) satisfies the differential equation; we 
need to show that for some set of constants Ci,...,C n it also satisfies the 
initial conditions. 

Differentiating (27.150) n—1 times and combining the result into a matrix 
equation, 



<K*o) 
<t>'(t 0 ) 



Vi (to) 

y' 2 (t 0 ) 



y n (t 0 ) \ ( d \ 
y'M c 2 



\ (n-l) 

\ Vi 



(to) y ( r 1] (to) 



y { n- 1} (t 0 ) J \c n J 

(27.152) 

The matrix on the right hand side of equation (27.152) is W[yi, ...,y n )(to). 
By assumption, the determinant W[yi, y n ](to) ^ 0, hence the corre- 
sponding matrix W[j/i, y n ](to) is invertible. Since W[yi, y n ](to) is 
invcrtible, there is a solution {C±, C n } to the equation 




= W[2/i,...,2/„](t 0 ) 



given by 



V c„ 



{W[ yi ,..,y„](t 0 )}- 



//() 



(27.153) 



(27.154) 



Hence there exists a non-trivial set of numbers {C\, C„} such that 

<t>(t) = C m + C 2 y 2 + ■■■ + C n y n (27.155) 
satisfies the initial value problem (27.151). 

By uniqueness, every solution of this initial value problem must be identical 
to (27.155), and this means that it must be a linear combination of the 
{yi, -,y n }' 

Thus every solution of the differential equation is also a linear combination 
of the {yi, y n }, and hence y n } must form a fundamental set of 

solutions. 

To prove the converse, suppose that y\, y n are a fundamental set of solu- 
tions. We need to show that for some number to £ (a, b), W[yi, y n ](to) ^ 
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0. Since yi,...,y n form a fundamental set of solutions, any solution to the 
initial value problem (27.151) must have the form 

<Kt) = C m + C 2 y 2 + ■■■ + C n y n (27.156) 

C n }. Hence there must exist constants 



for some set of constants {C\ 
C\, C„ such that 

Cm(t 0 ) + - 

Ciy' 1 (t 0 ) + - 



C n y n (t 0 ) = y 0 

c n y' n (to) = yi 



(27.157) 



C n yn ^ (to 



) = Vn-l 



i.e., there is a solution {Ci, C„} to 

Vi(to) ■■■ y n {to) 



,(»-!), 



yi '(to) ■■■ ylr 1} (t Q ) 

This is only true if the matrix 

/ 2/i (*o) 







- 


(yo\ 


) 


V c n ) 




V Vn J 



(27.158) 



W[ yi ,...,y n }(t 0 ) 



(n-l) 



(to) 




(27.159) 



is invertible, which in turn is true if and only if its determinant is nonzero. 
But the determinant is the Wronskian, hence there exists a number to such 
that the Wronskian W[y\, ...,y n ](t 0 ) ^ 0. □ 

Theorem 27.9. Suppose yi,...,y n are solutions L n y = 0 on an interval 
(a, b), and let their Wronskian be denoted by W[yi, ...,y n ](t). Then the 
following are equivalent: 

1. W[ yi ,...,y n ](t)^0 Vie (a, 6) 

2. 3t Q e (a,b) such that W[yi, ...,y n ](t 0 ) ^ 0 

3. y\,...,y n are linearly independent functions on (a,b). 

4. yi, y n are a fundamental set of solutions to L n y = 0 on (a, b). 

Example 27.10. Two solutions of the differential equation 2t 2 y" + 3ty' — 
y = 0 are y\ = t 1 ^ 2 and y 2 = 1/t; this can be verified by substitution into 
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the differential equation. Over what domain do these two functions form a 
fundamental set of solutions? 



W(t) = 



(27.160) 



Calculating the Wronskian, we find that 

t 1 / 2 l/t 
l/(2t 1 / 2 ) -l/t 2 

t 1 ' 2 1 

= -^-W (27 - 161) 

= wn ( 27 - 162 ) 

This Wronskian is never equal to zero. Thus these two solutions form a 
fundamental set on any open interval over which they are defined, namely 
t > 0 or t < 0. □ 

Theorem 27.10 (Abel's Formula). The Wronskian of 

a n {t)y (n) + o^!^ 1 "" 1 ' + • • • + ax{t)y + a 0 (t) = 0 (27.163) 

is 

W{t) = Ce~J' p(t}dt (27.164) 
where p(t) = a n —i(t)/a n (t). In particular, for n = 2, the Wronskian of 

y" +P(t)y' + q(t)y = 0 (27.165) 

is also given by the same formula, W(t) = Ce~ -I pW dt . 

Lemma 27.11. Let M be an n x n square matrix with row vectors rrii, 
determinant M , and let d(M, i) be the same matrix with the ith row vector 
replaced by drrii/dt. Then 

j n 

— det M — det d(M, i) (27.166) 

2 — 1 

Proof. For n=2, 

dM d 

—TT = 3t( to h to 22 - m-i 2 m 2 i) (27.167) 
at dt 

= mnm'22 + ti'hTO22 — mi277i 21 — m' 12 r7i2i (27.168) 

Now assume that (27.166) is true for any n x nmatrix, and let M be any 
n + lx n + 1 matrix. Then if we expand its determinant by the first row, 

n+l 

M = ^(-l) 1+l m H miri(mH) (27.169) 
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where min(mjj) is the minor of the zjth element. Differentiating, 

dM n+1 n+1 d 

— = ^(-l) 1+i m' li min(m li ) + ^(-1) 1+j toi 4 — min^) 



The first sum is d(M,l). Since (27.f66) is true for any n x n matrix, we 
can apply it to min(mii) in the second sum. 



dM 

dt 



d(M,f) + Er=i 1 (-l) 1+l ™HE"=i<niin(™ ll ),j) 



which completes the inductive proof of the lemma. 



(27.171) 



□ 



Proof. (Abel's Formula) 

(n = 2). Suppose y\ and j/2 are solutions of (27.165). Their Wronskian is 



W(t) = yiy' 2 ~ y 2 y[ 

Differentiating, 

W'(x) = yiy'J, + y[y' 2 - y' 2 y' x - y 2 y" = yiy' 2 ' ~ V2y" 
Since L 2 yi = L 2 y 2 = 0, 

y'l = -p(t)y[ - q(t)yi 

2/2 = -p(t)V2 - 3(*)j/a 

Hence 

W'(t) = yi(-p{t)y' 2 -q{t)y2)-y2{-p(t)y' 1 -q(t)y 1 ) 

= -p(t)(yiy 2 - y 2 y[) 
= - P (t)w(t) 

Rearranging and integrating gives W(t) — Cexp [— J p(t)dt] . 
General Case. The Wronskian is 



W[ yi ,...,y n ](t) 



Hi 



(n-l) 



Vn 



■ ■ y 



(n-l) 



(27.172) 

(27.173) 

(27.174) 
(27.175) 

(27.176) 



(27.177) 
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By the lemma, to obtain the derivative of a determinant, we differentiate 
row by row and add the results, hence 



dW 
~d~t 



v'i 



(n-l) 



Vn 
Vn 



(n-l) 
Vn 



v'i 
v'i 
v'i 



(n-l) 



Vn 

y'k 
y' n 



(n-l) 
Vn 



+ ••• + 



yi 
y[ 
yi 



Vn 
Vn 

y'L 



(27.178) 



in) 



in) 
Vn 



Every determinant except for the last contains a repeated row, and since 
the determinant of a matrix with a repeated row is zero, the only nonzero 
term is the last term. 



dW 

~dt 



Vi 

y'i 
v'i 



(n) 



Vn 
V'n 

y'n 



,(«) 



(27.179) 



Since each yj is a solution of the homogeneous equation, 



,(«) 



a n -i(t) (n— 1) Q>n— 2 V^J (n— 2) 



n — 1 

a n (t) to 



a n (t) y > 



ao(t) 
a„{t) 



a-i{t)y) 



% (27.180) 



(27.181) 



Hence 
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dW 
dx 



yi 



(n-2) 
1 n— 1 



y n 
y' n 



(n-2) 
In 

ri-1 



(i) 



(27.182) 



The value of a determinant is unchanged if we add a multiple of one to an- 
other. So multiply the first row byao (i) /a„ (i ) , the second row bya2 (t)/a n (t), 
etc., and add them all to the last row to obtain 



dW 

~dt 



yi 
y[ 



(n-2) 

y\ 



y n 
y'n 



(n-2) 



-pirn 



(n-1) 



-p(t)y 



(n-1) 



(27.183) 



where p(t) = a n -i(t) /a n (t). We can factor a constant out of every element 
of a single row of the determinant if we multiply the resulting (factored) 
determinant by the same constant. 



dW 
~dt 



-P(t) 



2/1 




y n 


y[ 




y'n 


(n- 

Wi 

(n- 

2/i 


2) 
1) 


y { n~ 2) 



-p{t)W(t) 



(27.184) 



Integrating this differential equation achieves the desired formula for W . 

□ 

Example 27.11. Calculate the Wronskian of y" — 9y = 0. 
Since p(t) = 0, Abel's formula gives W = Ce~ f o dt = C. □ 

Example 27.12. Use Abel's formula to compute the Wronskian of y'" — 
2y" -y'-3y = 0 

This equation has p(t) = -2, and therefore W = Ce~ f<-- 2 ) dt = Ce 2t . □ 

Example 27.13. Compute the Wronskian of x 2 ?/ 77 * 1 +y" — 4a; = 0. 

We have p(t) = t/t 2 = 1/t. Therefore W = Ce~ S0-/t)dt = Ce -int = C j t _ 
□ 
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Example 27.14. Find the general solution of 

ty'" - y" -ty' + y = 0 

given that y — e* and y = e~ l are solutions. 
From Abel's formula, 



W(t) = cxp 
By direct calculation, 

w(ty 



{-/< 



(-l/t)dt } = cxp{lnt} = t 



-e * e* y' 
e~* e* y" 



e- y 

e* y" 



+ e- 



e y 
e* y" 



+ e 



e y 
e* y' 



= e-'[(eV' - eV) + (eV - e*») + (eV - e*y)] 

= y" - v + y" - v + v - v 

= 2y" - 2y 



(27.185) 



(27.186) 



(27.187) 

(27.188) 

(27.189) 
(27.190) 
(27.191) 



Setting the two expressions for the Wronskian equal to one another, 



y -y = 



The method of undetermined coefficients tells us that 

1 



y = C x e~ % + C 2 e f - -t 



(27.192) 



(27.193) 



is a solution ( the first two terms are yu and the third is yp). □ 
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Variation of Parameters 

Theorem 27.12 (Variation of Parameters.). Suppose that y\, ...,y n are a 
fundamental set of solutions to 

L n y = a n (t)y^ + a n ^{t)y^ + ■■■ + a 0 (t)y = 0 (27.194) 

Then a particular solution to 

L n y = a n (t)y^ + a n ^(t)y^ + ■■■ + a 0 (t)y = f(t) (27.195) 

is given by 

f W 1 (s)f( S ) f W 2 (s)f(s) 

J t W(s)a n (s) J t W(s)a n (s) 

[ W n (s)f( S ) (07^QR\ 

H \-y n / ttt^-, — ^rds (27.196) 

J t W(s)a n (s) 

where Wj(t) is the determinant of W[j/i, ...,y n ](t) with the jth column 
replaced by a vector with all zeroes except for a 1 in the last row. In 
particular, for n — 2, a particular solution to a(t)y" + b(t)y' + c(t)y = f(t) 
is 

yp = - yi{t) I wms) ds + mit) I w{^w) ds (27 - 197) 

Proof for general case. Look for a solution of the form 

y = um + ---+u n y n (27.198) 

This is under-determined so we can make additional assumptions; in par- 
ticular, we are free to assume that 



Then 



u[yi H h u' n y n = 0 

u'iV'i + ■■■+ u' n y' n = 0 



/ (ra-2) . . , (n-2) 

UiVi ' + ■■■+ u' n y n 



y' = u iy [ + ■■■ + u n y' n 
y" = u iy '{ + ■■■+ u n yl 



y — u\y 1 -+- -t u n y n 

( n ) i i ( n ) i / (n— 1) , . / In— 1) 

yW = myl H h u n y y n + u\y\ H h <jA 



(27.199) 



(27.200) 
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So that 
/(*) 



= a n (t)y {n) + o„_i(t)y( n - 1 ) + • ■ ■ + a 0 (t)y 
= a n {t) uiy\ H h ' + ' + 



On-l(t) 



(n-1) 

uiVi 



UnU, 



(n-1) 



[uil/i H 1" + Oo(*) Nz/i 

a„(i) 



"nj/nj 



, (n-1) 



, (n-1) 

«„yn 



Combining (27.201) and (27.199) in matrix form, 



2/i 



2/2 
J/ 2 



yn \ 



(n-2) (n-2) 
\ (n-1) (n-1) 



yn 

(n-1) 
Vn 



(27.201) 



V /(«)/*»(*) / 

(27.202) 

The matrix on the left is the fundamental matrix of the differential equation, 
and hence invertible, so that 



V < J 



( y} 



v [ r 2) 



Vn \ 
V'n 

(n-2) 
n 



( 



\ 



fit) 

a n (t) 



\f(t)/a n (t)J 



(27.203) 

where W is the fundamental matrix and [VF -1 ]^ denotes the ijth element 
of W" 1 . 



Therefore 



3 " 



cof[W] n 
detW 



Wj{t) 
W(t) 



(27.204) 



Ui{t) 



diH = f{t)Wj(t) 
dt a n (t)W(t) 

f(s)W i (s) 



ds 



(27.205) 



(27.206) 



a n (s)W(s) 

Substitution of equation (27.206) into equation (27.198) yields equation 
(27.196). □ 



254 



LESSON 27. HIGHER ORDER EQUATIONS 



Example 27.15. Solve y'" + y' = tant using variation of parameters. 

The characteristic equation is 0 = r 3 + r = r(r + i)(r — i); hence a funda- 
mental set of solutions are y\ = 1, yi = cost, and y 3 = sint. From either 
Abel's formula or a direct calculation, W(t) — 1, since 



W 



1 cos t sin t 
0 — sin t cos t 
0 —cost — sint 



VP 



ds+y-. 



W 2 (s)f(s) 



W 3 (s)f(s) 



lt W( S )a 3 ( S r~ ia <J t W(s)a 3 (s) 
where as(s) = 1, f(s) = tans, and 

0 cos t sin t 



sin t cos t 
cos t — sin t 



W 2 = 



1 0 sint 

0 0 cos t 

0 1 -sini 

1 cos t 0 
0 -sint 0 
0 — cos t 1 



= — cos t 



= — sin t 



(27.207) 
ds (27.208) 

(27.209) 

(27.210) 
(27.211) 



Therefore 



yp = J^t&nsds — cos t J cos s tan sds — sin t^" sin s tan sds (27.212) 
Integrating the first term and substituting for the tangent in the third term, 



Kir = - I" cos/ 1 - < os £ J* sin sds — suit J 



■ 2 
sm s 



ds 



coss 



(27.213) 



The second integral can not be integrated immediately, and the final inte- 
gral can be solved by substituting sin 2 s = 1 — cos 2 s 



yp=— In |cost| + cos t 



f 1 

— sm t / — 



cos 2 s 



cos s 



ds 



(27.214) 



Since the first term (the constant) is a solution of the homogeneous equa- 
tion, we can drop it from the particular solution, giving 

yp = In |cost| — sin tin |sect + tant| (27.215) 

and a general solution of 

y = In |cost| — sint In |sect + tant| + C\ + C2 cost + C3 sint. □ (27.216) 



Lesson 28 



Series Solutions 



In many cases all we can say about the solution of 

a(t)y" + b(t)y' + c(t)y = f(t) ' 

y(h) = y 0 } (2S.1 ) 

y'(t 0 ) = yi 

is a statement about whether or not a solution exists. So far, however, we 
do not have any generally applicable technique to actually find the solution. 
If a solution does exist, we know it must be twice differentiable (n times 
differentiable for an nth order equation). 

If the solution is not just twice, but infinitely, differentiable, we call it an 
analytic function. According to Taylor's theorem, any function that is 
analytic at a point t — to can be expanded in a power series 

oo 

y(t) = ^ afe (i-t 0 ) fe (28.2) 

fc=0 

where 

a„ = ^ (28.3) 
fc! 

Because of Taylor's theorem, the term analytic is sometimes used to mean 
that a function can be expanded in a power series at a point (analytic <^=> 
infinitely differentiable power series exists). 

The method of series for solving differential equations solutions looks 
for analytic solutions to (28.1) by substituting equation (28.2) into the 
differential equation and solving for the coefficients ao,ai, ... 
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If we can somehow find a non-trivial solution for the coefficients then we 
have solved the initial value problem. In practice, we find the coefficients 
by a generalization of the method of undetermined coefficients. 



Example 28.1. Solve the separable equation 

(28.4) 



ty' - (t + l)y = 0 
2/(0) = 01 



by expanding the solution as a power series about the point £q = 0 and 
show that you get the same solution as by the method of separation of 
variables. 

Separating variables, we can rewrite the differential equation as dy/y = 
[(t + \)/t]dt\ integrating yields 

\a\y\ =i + ln|t| +C (28.5) 

hence a solution is 

y = cte 1 (28.6) 

for any value of the constant c. We should obtain the same answer using 
the method of power series. 

To use the method of series, we begin by letting 



y(t) = ^2a k t k (28.7) 

fc=0 

be our proposed solution, for some unknown (to be determined) numbers 
ao, a\, Then 

oo 

y' = Y,ka k t k - 1 (28.8) 

k=Q 

Substituting (28.7) and (28.8) into (28.4), 



OO OO 

0 = ty' -(t+ l)y = t fcflfet^ 1 - (t + 1) ^ a k t k (28.9) 

fc=0 fe=0 
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Changing the index of the second sum only to fc = m — 1, 

CO oo oo 

0 = ^ka k t k - ^a k t k+1 - ^a k t k (28.10) 

k=0 k=0 k=0 

oo oo oo 

= J2ka k t k -J2 a m-it m -J2 a k tk ( 28 - n ) 
fe=0 m=l fe=l 
oo oo 

= ^(fc-l)a fc i fc -^a fe _i^ (28.12) 

fc=l k=l 
oo 

= J2[(k-l)a k -a k -i]t k (28.13) 
fc=i 

In the last line we have combined the two sums into a single sum over k. 

Equation (28.13) must hold for all t. But the functions {l,i,i 2 ,...} are 
linearly independent, and there is no non-trivial set of constants {C k } such 
that X^feLo Ckt k — 0, i.e., C' k — 0 for all k. Hence 

a 0 = 0 (28.14) 

(fc - l)o fc - o fc _i = 0, fc=l,2,... (28.15) 

Equation (28.15) is a recursion relation for a k ; it is more convenient to 
write it as (k — l)a k = a k -i- For the first several values of k it gives: 

fc = l:0-a 1 =a 0 (28.16) 

k = 2 :1 • a 2 = Oi =► a2 = Oi (28.17) 

fc = 3 :2 • a.3 = a.2 as = -a.2 = -ai (28.18) 

k = 4 :3 • a 4 = a 3 => a 4 = ^a 3 = — -ai (28.19) 

k = 5 :4 • as = a 4 => as = -a 4 = - — - — -ai (28.20) 



The general form appears to be a k = a±/(k — 1)!; this is easily proved by 
induction, since the recursion relationship gives 



a k+1 = a k /k = ai /[k ■ (k - 1)!] = <n/fc! (28.21) 
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by assuming =a\/(k — 1)! as an inductive hypothesis. Hence 

y = ait + a 2 t 2 + a 3 t 3 H (28.22) 

= ai (t + t 2 + ^ 3 + ^ 4 + i* 5 + • • • ) (28.23) 

= ait (l + 1 + ^ 2 + ^i <3 + ^ 4 + ' ' ' ) ( 28 - 24 ) 
= oiie* (28.25) 

which is the same solution we found by separation of variables. We have 
not applied the initial condition, but we note in passing the only possible 
initial condition that this solution satisfies at to = 0 is y(0) =0. □ 

Example 28.2. Find a solution to the initial value problem 

y"-ty'-y = 01 

2/(0) = 1 I (28.26) 
2/(0) = lj 

Letting y = J2T=o Cfe ^ an ^ differentiating twice we find that 

oo 

y' = Y,kc k t k - 1 (28.27) 

fc=0 
oo 

y" = ^] fc(fc - l)c fc t fe - 2 (28.28) 

fc=0 

The initial conditions tell us that 

c 0 = 1, (28.29) 
ci = 1 (28.30) 

Substituting into the differential equation. 

oo oo oo 

0 = k ( k - l ) c kt k ~ 2 - t kc^- 1 - Y c k t k (28.31) 

fe=0 fe=0 fe=0 

Let j = k — 2 in the first term, and combining the last two terms into a 
single sum, 

oo oo 

0 = Y C? + 2 )0' + l ) c j+2t 3 - 5> + l)c fe i fe (28.32) 

j=-2 fe=0 
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Since the first two terms (corresponding to j = —2 and j = —1) in the 
first sum are zero, we can start the index at j = 0 rather than j — —2. 
Renaming the index back to k, and combining the two series into a single 
sum, 

oo oo 

0=^(fc + 2){k + l)c k+2 t k - J2( k + l ) c kt k (28.33) 

k=0 k=0 

By linear independence, 

(k + 2){k + l)c k+2 = (k + l)c k (28.34) 

Rearranging, c k + 2 = c k /(k + 2); letting j = k + 2 and including the initial 
conditions (equation (28.29)), the general recursion relationship is 

c 0 = 1, ci = 1, c fc = c fe _ 2 /fc (28.35) 



Therefore 



C > = J = 2 C3 = 3 = 3 (28 - 36) 

C2 1 C 3 1 

C4= 4=4T2 C5 = ¥ = 5T3 (28 - 37) 

C6 = ^ = 6T4T2 C7= 7^7^ (28 " 38) 



So the solution of the initial value problem is 

y=c 0 + d* + c 2 i 2 + c 3 t 3 H (28.39) 

= 1 + ^ 2 + 4 1 2* 4 + ^ 6 + - (^40) 

+t + ^ + ^ + 7 ^ + ... □ (28.41) 

Example 28.3. Solve the Legendre equation of order 2, given by 

(l-f 2 )y"-2V + 6y = 0 > | 

2/(0) = 1 } (28.42) 
2/(0) =0j 

We note that "order 2" in the name of equation (28.42) is not related to the 
order of differential equation, but to the fact that the equation is a member 
of a family of equations of the form 

(1 - t 2 )y" - 2ty' +n{n + l)y = 0 (28.43) 
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where n is an integer (n = 2in this case). Expanding as usual we obtain 

oo 

y = Y^^t k (28.44) 

oo 

y'-^fcc^- 1 (28.45) 

oo 

y" =^fc(fc-l)c fe t fe - 2 (28.46) 

fc=0 

Substituting into the differential equation, 

oo oo oo 

0 = (f - t 2 ) c kH k - l)t k ~ 2 -2tJ2 c k kt k - x + 6 c k tk (28-47) 

k=0 fe=0 fc=0 

oo oo oo oo 

= c kK k - l ) tk ~ 2 - Y c kk{k - l)t k - 2t ^ Ckkt k - X + &Y Ckktk 

fc=0 fc=0 fe=0 fe=0 

(28.48) 

OO OO OO 

= Y c kk{k - l)t k - 2 -2tY c k kt k - 1 + Y( 6 - k 2 + k)c k t k (28.49) 

fc=0 k=0 k=0 



The first term can be rewritten as 



Y c kHk - l)t k - 2 = J2 c kk{k - l)t k - 2 (28.50) 

k=2 
oo 

= Y c m+2(m + l)(m + 2)t m (28.51) 

m=0 

oo 

= Y c k+2(k + l)(k + 2)t k (28.52) 



k=0 k=2 



k=0 



and the middle term in (28.49) can be written as 

oo oo 

-2*^c fc fci fc_1 = Y(- 2 ) kc k tk (28.53) 



k=0 k=0 
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Hence 



0 = Ck +^ k + !)( fc + 2 ) fk + ^(-2)A:c fc t fe + ]T(6 -k 2 + k)c k t k 

k=0 k=0 k=0 

(28.54) 

OO OO 

= c k+2(k + l)(fc + 2)t k + Y,(k 2 +k- Q)c k t k 



k=0 

oo 



fe=0 



= \- Ck +^ k + X )( fc + 2) - (fc + 3)(fc - 2)c fc ] t fc 
fc=i 

By linear independence 



(fc + 3)(fc-2) 

Cfc+2 = , on/,, , 7T C fc> « = 0, 1, ... 



(28.55) 
(28.56) 



or 



Cfc 



(ft + 2)(fc + l) 
(fc + l)(fc-4) 



fc(fc- 1) 



Cfe-2, fc = 2,3, ... 



(28.57) 



(28.58) 



From the initial conditions we know that cq = 1 and ci = 0. Since C3, C5, 
... are all proportional to Ci, we conclude that the odd- indexed coefficients 
are all zero. 

Starting with k = 2 the even-indexed coefficients are 
(2 + l)(2-4) 



C2 



-c 0 = -3c 0 



2(2-1) 

= c 

C6 = cs = C10 = • • • = 0^ 



(4+l)(4-4) 
C4= 4(4-1) C2 = ° 



(28.59) 



Hence 



y = c 0 + cii + c 2 i 2 + c 3 t 3 



1 - 3t z 



(28.60) 



which demonstrates that sometimes the infinite series terminates after a 
finite number of terms. □ 
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Ordinary and Singular Points 

The method of power series solutions we have described will work at any or- 
dinary point of a differential equation. A point t = t n is called an ordinary 
point of the differential operator 

L n y = a n (t)y^ + a n ^(t)y^ + ■■■+ a 0 (t)y (28.61) 

if all of the functions 

»c» - W> (2M2 > 

are analytic at t — to, and is called a singular point (or singularity) of 
the differential operator if any of the Pk(t) are not analytic at t = to- If not 
all the Pk{t) are analytic at t = to but all of the functions 

qk(t) = (t-to) n - k p k (t) (28.63) 

namely, 



n\ n + x a n-i(*) 

9"-l(*) = (*-*0)-^- 
1n-2(t)-(t-t 0 ) 

qo (t) = (t-tor a °t t l 



(28.64) 



a n {t) 

are analytic, then the point is called a regular (or removable) singular- 
ity. If none of the qk(t) are analytic, then the point is called an irregular 
singularity. We will need to modify the method at regular singularities, 
and it may not work at all at irregular singularities. 

For second order equations, we say the a point of t = to is an ordinary 
point of 

y"+p(t)y' + q(t)y = 0 (28.65) 

if both p(t) and q(t) are analytic at t = t n ; a regular singularity if 
(t — to)p(t) and (t — t 0 ) 2 q(t) are analytic at t = t 0 ; and an irregular 
singularity if at least one of them is not analytic at t = to 

Theorem 28.1. [Existence of a power series solution at an ordinary point] 
If {pj(t)}, j = 0, 1, ...,n — 1 are analytic functions at t = to then the initial 
value problem 



y (n) +Pn-i{t)y {n - 1] +p„- 2 (% ( "- 2) + • • ■+ Po (t)y - o] 
y(to) = yo,y'(t 0 ) = yi, ...,y™ _1 (t 0 ) = y n I 



(28.66) 
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has an analytic solution at t = ioj given by 



y = Y, c k(t-to) k 

k=0 



where 



Vk 

kV 



k = 0, 1, n — 1 



(28.67) 



(28.68) 



and the remaining Ck may be found by the method of undetermined coef- 
ficients. Specifically, if p(t) and q(t) are analytic functions at t = io ? then 
the second order initial value problem 

y"+p{t)y' + q{t) y = o' 

y(to) = 2/o > (28.69) 

y'(h) = y\ 4 

has an analytic solution 



y = yo + yi{t-t 0 ) + Y^ °k(t - t Q ) k 



(28.70) 



k=2 



Proof, (for n = 2). Without loss of generality we will assume that t 0 = 0. 
We want to show that a non-trivial set of {cj} exists such that 



oo 

y = c i td 

j=o 



(28.71) 



To do this we will determine the conditions under which (28.71) is a solution 
of (28.69). If this series converges, then we can differentiate term by term, 



oo 

.</ ;>>..'" : 

3=0 

2/" = £i(i-i)c,-^ 

3=0 



(28.72) 



(28.73) 



Observing that the first term of the y' series and the first two terms of the 
y" series are zero, we find, after substituting k = j — 1 in the first and 
k = j — 2 in the second series, that 



y' = J2(k + l)c k +it k 

oo 

y" = ^(fc + 2)(fc + l) Cfc+2 i fe 



(28.74) 
(28.75) 



fe=0 
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Since p(t) and q(t) are analytic then they also have power series expansions 
which we will assume are given by 

oo 

p(t)=J2Pjt j (28-76) 

3=0 

oo 

?(*) = E%* j ( 28J? ) 

with some radius of convergence R. Substituting (28.71), (28.74) and (28.76) 
into (28.69) 

OO / OO \ / oo \ 

o=^(fc + 2)(fc + i) Cfc+2 ; fc + Y,p^ E( fc + 1 )^+i ife 

fe=0 \j=0 J Vfc=0 / 

oo \ / oo \ 

E^J E c *n ( 28 - 78 ) 

v j=0 / \fc=0 / 
Since the power series converge we can multiply them out term by term: 



oo oo 



0 = E( fc + 2 ) ( fc + l ) c k+2t k + E E Pi t0 ( fc + l)c fc +lt A 

fc=0 j=0 k=0 



oo oo 



+ ^^q 3 t ] c k t k (28.79) 

j=0 k=0 

We next use the two identities, 

oo oo oo k 

J2 E( fc + l)<*+iPi** + * = E + l ) c i+W*-3 tk (28-80) 

fc=0j=0 fc=0 j=0 

and 

oo oo oo k 

E E EE «*-^-<* (28-81) 

fc=0j=0 fe=0j'=0 

Substituting (28.80) and (28.81) into the previous result 

oo 

0 = ^(fc + 2)(fc + l)c fe+2 i fc (28.82) 

k=0 

Since the i fe are linearly independent, 

k 

(k + 2){k + l)c k+2 = -J2 iti + l)c j+ iPk-3 + Wk-j] (28.83) 

3=0 
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By the triangle inequality, 

k 

\(k + 2)(k + l)c k+2 \ < [(? + 1) \cj+i\ \Pk-j\ + \cj\ \q k -j\] (28-84) 

3=0 

Choose any r such that 0 < r < R, where R is the radius of convergence 
of (28.76). Then since the two series for p and q converge there is some 
number M such that 

\pj\r j < M, \ qj \r j < M (28.85) 

Otherwise there would be a point within the radius of convergence at which 
the two series would diverge. Hence 

\(k + 2)(k + l)e fe+2 | < ^ Ei=o r j [(J + 1) \c j+ i\ + \ Cj \] (28.86) 

where in the second line we are merely adding a positive number to the 
right hand side of the inequality. Define Cq = |cq| , C\ = |ci|, and define 
C,.r ; .... by 

M k 

(k + 2)(k + l)C k+2 = ^J2 r3 tC? + Wj+i + Cj] + MC k+1 r (28.87) 

r 3=0 

Then since \(k + 2){k + l)c k+2 \ < (k+2)(k+l)C k+2 we know that \c k \ < C k 
for all k. Thus if the series J2T=o Ckt k converges then the series J2"kLo c k^ k 
must also converge by the comparison test. We will do this by the ratio 
test. From (28.87) 

M k ~ 1 

k{k + l)C k+1 = J2 r3 IU + + Cj] + MC k r (28.88) 

T 3=0 

M k ~ 2 

k(k - l)C k = _ £V tO' + + Cj] + MC k -ir (28.89) 

3=0 

Multiplying (28.88) by r, and writing the last term of the sum explicitly, 

k(k + l)C k+1 r = ^ E 3 to r j [(j + l)C j+1 + Cj] + MC k r 2 

= ^2 ^3=0 r3 [U + l )°3+i + Cj] + Mr [kC k + C fc _i] + MC k r 2 

(28.90) 
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Substituting equation (28.89) into equation (28.90) 

rk{k + l)C k+1 = k(k~l)C k -MC k ^r + M[kC k + C k ^]r + MC k r 2 

(28.91) 

Dividing by rk{k + l)C k gives 

Cfc+i k(k-l) + Mkr + Mr 2 



C k rk(k + 1) 

Multiplying by t — t k+1 /t and taking the limit as k — > oo 

k(k - 1) + Mkr + Mr 2 



lim 



Ck+it +1 


= lim 




k— >oo 



rk(k + 1) 

Dividing the numerator an denominator by k 2 , 



(28.92) 



(28.93) 



lim 



n +fc+i 



c k t k 



\t\ lim 



1 - 1/k + Mr/k + Mr 2 /k 2 



- r/k 



(28.94) 



Therefore by the ratio test X^feLo C k t k converges for \t\ < r, and hence 
by the comparison test XfcLo Ck ^ k a ^ so converges. Therefore there is an 
analytic solution to any second order homogeneous ordinary differential 
equation with analytic coefficients. The coefficients of the power series 
are given by Cq — yo, c\ — y\ (by Taylor's theorem) and the recursion 
relationship (28.83) for 02,03,... □ 

Many of the best-studied differential equations of mathematical physics 
(see table 28.1) are most easily solved using the method of power series 
solutions, or the related method of Frobenius that we will discuss in the 
next section. A full study of these equations is well beyond the scope of 
these notes; many of their most important and useful properties derive from 
the fact that many of them arise from their solutions as boundary value 
problems rather than initial value problems. Our interest in these functions 
is only that they illustrate the method of power series solutions. 

Example 28.4. Find the general solutions to Airy's Equation: 



V 



til 



Using our standard substitutions, 

00 



k=0 



= f>(fc-l)t 



fc-2 



(28.95) 

(28.96) 
(28.97) 



fc=0 
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Table 28.1: Table of Special Functions denned by Differential Equations. 



Name 

of Equation 


Differential Equation 
Names of Solutions 


Airy 

Equation 


v" = ty 

Airy Functions Ai(i), Bi(t) 


Bessel 
Equation 


t 2 y" + ty' + (t 2 - v 2 )y = 0, 2v e Z+ 
Bessel Functions J v (t) 
Neumann Functions Y u (t) 


Modified 

Bessel 

Equation 


t 2 y" + ty' - (t 2 + v 2 )y = 0, v G Z + 
Modified Bessel Functions I v {t), K v {x) 
Hankel Functions H v {t) 


Euler 
Equation 


t 2 y" + aty' + fly = 0, a, /3 e C 
t r , where r(r — 1) + ar + (3 = 0 


Hcrmite 
Equation 


y" - 2ty' + 2ny = 0, n£ Z+ 
Hcrmite polynomials H n (t) 


Hypergeometric 
Equation 


t(l - t)y" + (c - (a + b + l)t)y' - aby = 0,a,b,c,deR 
Hypergeometric Functions F, 2F1 


T v. • 

Jacobi 
Equation 


t(l — t)y + [q — [p + l)t\y + n(p + n)y = 0, n E £, a, b e K 
Jacobi Polynomicals J n 


Kummer 
Equation 


ty" + (b- t)y' -ay = Q,a,beR 
Confluent Hypergeometric Functions i-Fi 


Laguerre 
Equation 


ty" + (1 - t)y' + my = 0, m e Z+ 
Laguerre Polynomials L m (t) 


Associated 
Laguerre Eqn. 


ty" + {k + l-t)y 

Associated Laguerre Polynomials 


Legendre 
Equation 


(1 - i 2 )y" - 2ty' + n(n + l)y = 0, ne Z+ 
Legendre Polynomials P n (t) 


Associated 
Legendre Eq. 


(1 - t 2 )y" - 2ty' + n(n +1)-^ y = 0,m,neZ+ 
Associate Legendre Polynomials P™{t) 


Tchebysheff 
Equation 


(l-t 2 )y"- ty' + n 2 y = 0 (Type I) 

(1 - t 2 )y" - 3ty' + n(n + 2)y = 0 (Type If) 

Tchebysheff Polynomials T n (t), U n (t) 
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in the differential equation gives 

oo oo oo 

Y k(k - l)a k t k - 2 = t Y a kt k = Y aktk+1 ( 28 - 98 ) 

fc=0 fc=0 fc=0 

Renumbering the index to j = k — 2 (on the left) and j = k + 1 (on the 
right), and recognizing that the first two terms of the sum on left are zero, 
gives 

oo oo 

J2U + 2)1? + l)a j+ 2t j = J2 a i-^ j ( 28 -") 

3=0 3=1 

Rearranging, 

oo 

2a 2 + Y [(■?' + 2 )0' + 1 ) a J+ 2 - = 0 (28.100) 

By linear independence, a 2 = 0 and the remaining otj satisfy 

(j + 2)0' + l)a J - +2 =o J -_i (28.101) 
If we let k = j + 2 and solve for a k , 

a k = ^ (28.102) 

The first two coefficients, a 0 and oi, are determined by the initial condi- 
tions; all other coefficients follow from the recursion relationship.. In partic- 
ular, since a 2 = 0, every third successive coefficient a 2 — a 5 = a 8 = • • • = 0. 
Starting with oo and a\ we can begin to tabulate the remaining ones: 

a 3 = (28.103) 



3 • 2 

a 3 a a 



6-5 6 • 5 • 3 • 2 



(28.104) 



and 



° 9 = 9T8 = 9.8.6.5.3.2 (28 - 105) 



«4 = ^3 (28.106) 

a 7 = ^- = (28.107) 

7-6 7.6.4.3 v ; 

° 10 = 1CT9 = 10.9.7^6.4.3 (28 - 108) 
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Thus 

1 



^=H 1+ 6< w+w (28 - io9) 
+ai< ( 1+ ^ 3+ ^ <6+ w 9+ --) (28 - 110) 

= a oyi (t) + am(t) (28.111) 

where y\ and yi are defined by the sums in parenthesis. It is common to 
define the Airy Functions 

Ai(t) = - 3i7i^»(*) ( 28 - 112 ) 

= + ^4M y2W (28 - n3) 

Either the sets {2/1,1/2} or {Ai, Bi} are fundamental sets of solutions to the 
Airy equation. □ 



Figure 28.1: Solutions to Airy's equation. Left: The fundamental set y% 
(solid) and y2{dashed). Right: the traditional functions Ai(t) (solid) and 
Bi(i) (dashed). The renormalization keeps Ai(£) bounded, whereas the un- 
normalized solutions are both unbounded. 




15 10 5 0 5 15 10 5 0 5 



Example 28.5. Legendre's Equation of order n is given by 

(1 - t 2 )y" - 2ty' + n(n + l)y = 0 (28.114) 

where n is any integer. Equation (28.114) is actually a family of differential 
equations for different values of n; we have already solved it for n = 2 in 
example 28.3, where we found that most of the coefficients in the power 
series solutions were zero, leaving us with a simple quadratic solution. 
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Figure 28.2: Several Legendre Polynomials. Pi (Bold); P2 (Bold, Dotted); 
P 3 (Bold, Dashed); P 4 (Thin, Dotted); P 5 (Thin, Dashed). 
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In general, the solutions of the nth equation (28.114) will give a polynomial 
of order n, called the Legendre polynomial P n (t). 

To solve equation (28.114) we substitute 

00 

y = Y^a k t k (28.115) 

fe=0 

00 

y 1 = Y^ka k t k - 1 (28.116) 

fe=0 

00 

y" =Y / Hk~l)a k t k - 2 (28.117) 

fe=0 
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into (28.114) and collect terms, 



oo 

,k 



0 = (1 - t 2 ) Hk ~ l)a k t k - 2 -2t^ ka^- 1 + n(n + 1) ^ a ^ 

fc=0 k=0 k=0 

(28.118) 

Let j = k — 2 in the first sum and observe that the first two terms in that 
sum are zero. 

oo oo 

0 = (J + + 2 K+2^' + [-k - k 2 + n{n + 1)] a k t k (28.119) 
j=a k=o 

We can combine this into a single sum in t k ; by linear independence all of 
the coefficients must be zero, 

(k + l)(k + 2)a k+2 - [k(k + 1) - n(n + l)]a k = 0 (28.120) 

for all k = 0, 1, 2, and therefore 

k(k + l) -n(n + l) 
ak + 2 = ( fc + l)(fe + 2) ^ .* = M,2,... (28.121) 

The first two coefficients, clq and ai are arbitrary. The remaining ones are 
determined by (28.121), and generates two sequences of coefficients 

01,03,05,07,... (28m) 
do, 0,2, Ct4, 00, ... 

so that we can write 

V = J2 aktk + aktk (28.123) 

k even k odd 

These two series are linearly independent. In particular, the right hand side 
of (28.121) vanishes when 

k(k + 1) = n(n + 1) (28.124) 



so that for k = n one of these two series will be a finite polynomial of order 
n. Normalized versions of the solutions are called the Legendre Polynomials, 
and the first few are given in the (28.125) through (28.135). 
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1 

t 

\ ^ - ^ 
\ 3t) 

\ (35i 4 - m 2 + 3) 

\ (63i 5 - 70t 3 + 15t) 
8 

— (231t 6 - 315i 4 + 105t 2 - 5) 
16 

— (429t 7 - 693i 5 + 315t 3 - 35i) 

(6435i 8 - 12012i 6 + 6930t 4 - 1260t 2 + 35) 

128 

— (I2155t 9 - 25740t 7 + 18018i 5 - 4620t 3 + 315i) 
128 

(46189i 10 - 109395i 8 + 90090t 6 - 30030t 4 + 3465t 2 - 63) 

256 

(28.135) 



(28 


125) 


(28 


126) 


(28 


127) 


(28 


128) 


(28 


129) 


(28 


130) 


(28 


131) 


(28 


132) 


(28 


133) 


(28 


134) 
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Summary of Power series method. 



To solve the linear differential equation 



L n y = a, 



■n 



(28.136) 



or the corresponding initial value problem with 



y(t 0 )=y 0 ,...,y (n - 1) (to) = m 



'■n 



(28.137) 



as a power series about the point t = <o 



oo 



1 



Let y = ^2c k (t-t 0 ) k 



k=0 



2. If initial conditions are given, use Taylor's theorem to assign the first 
n values of c k as 



3. Calculate the first n derivatives of y. 

4. Substitute the expressions for y,y', —,y^ n ' into (28.136). 

5. Expand all of the a„(i)that are not polynomials in Taylor series about 
t = to and substitute these expansions into the expression obtained 
in step 4. 

6. Multiply out any products of power series into a single power series. 

7. By an appropriate renumbering of indices, combine all terms in the 
equation into an equation of the form J^ fc Uk(t — £o) fe = 0 where each 
Uk is a function of some set of the Cfc. 

8. Use linear independence to set the u k — 0 and find a relationship 
between the Cfc. 

9. The radius of convergence of power series is min{ t .} (|t 0 — £j)) where 
{ti} is the set of all singularities of a(t). 



ctc = y 



(k) (t 0 )/kl=y k /kl, k = 0,l,...,n-l 



(28.138) 
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Lesson 29 

Regular Singularities 



The method of power series solutions discussed in chapter 28 fails when 
the series is expanded about a singularity. In the special case of regular 
singularity this problem can be rectified with method of Frobenius, which 
we will discuss in chapter 30. We recall the definition of a regular singular 
point here. 

Definition 29.1. Let 

a(t)y" + b(t)y' + c(t)y = 0 (29.1) 
have a singular point at to, i.e., a(to) — 0. Then if the limits 

hm tz^M = Ll (29 . 2 ) 

■m = L 2 (29.3) 

t-n 0 a(t) 

exist and are finite we say that to is a regular singularity of the dif- 
ferential equation. Note that these limits will always exist when the 
arguments of the limit are analytic (infinitely differentiable) at to- If either 
of the limits does not exist or are infinite (or the arguments of either limit 
is not analytic) then we say that to is an irregular singularity of the 
differential equation. If a(to) ^ 0 then we call to an ordinary point of 
the differential equation. 

Theorem 29.2. The power series method of chapter 28 works whenever the 
series is expanded about an ordinary point, and the radius of convergence 
of the series is the distance from to to the nearest singularity of a(t). 
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Proof. This is a restatement of theorem 28.1. □ 

Example 29.1. The differential equation (1 + t 2 )y" + 2ty' + 4t 2 y = 0 has 
singularities at t = ±i. The series solution a kt k about t 0 = 0 has a radius 
of convergence of 1 while the series solution J2^k(t — l) fc about to = 1 has 
a radius of convergence of \f2. □ 

The Cauchy-Euler equation 

t 2 y" + aty' + fiy = 0 (29.4) 

where a, /3 € R is the canonical (standard or typical) example of a differ- 
ential equation with a regular singularity at the origin. It is useful because 
it provides us with an insight into why the Frobenius method that we will 
discuss in chapter 30 will work, and the forms and methods of solution 
resemble (though in simpler form) the more difficult Frobenius solutions to 
follow. 

Example 29.2. Prove that the Cauchy-Euler equation has a regular sin- 
gularity at t = 0. 

Comparing with equation 29.1, we have that a(t) = t 2 , b(t) = at, and 
c(t) = p. First, we observe that a(0) = 0, hence there is a singularity at 
t = 0. Then, applying the definition of a regular singularity (definition 
29.1) with t = 0, 



lim = a (29.5) 

t^o t 2 

lim - /3 (29.6) 

t^o t 2 

Since both a and (3 are given real number, the limits exist and are finite. 
Hence by the definition of a regular singularity, there is a regular singularity 
at t = 0. □ 

The following example demonstrates one of the problem that arises when we 
go blindly ahead and attempt to find a series solution to the Cauchy-Euler 
equation. 

Example 29.3. Attempt to find a series solution about t = 0 to the 
Cauchy-Euler equation (29.4). 

We begin by letting y = J2kLo a ^ m (29-4), which gives 
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0 = * 2 akk ( k ~ + at H ka k t k ^ +(3^2 a kt k (29.7) 

fe=0 k=0 k=0 

oo oo oo 

= a kHk - i)t k + aka kt k + @ aktk ( 29 - 8 ) 

k=0 fc=0 k=0 

oo 

= aktk [k(k-l) + ak + p] (29.9) 

k=0 

Since this must hold for all values of t, by linear independence we require 
that 

a k [k{k- 1) +ak + P] = 0 (29.10) 

for all k = 0,1,... 
Hence either 

a fe = 0 (29.11) 



or 



k(k- 1) + ak + (i = 0 (29.12) 



for all values of k. Since a and /3 are given real numbers, it is impossible 
for (29.12) to hold for all values of k because it is quadratic k. It will hold 
for at most two values of fc, which are most likely not integers. 

This leads us to the following conclusion: the only time when (29.4) has a 
series solution is when 

1 - a ± J (I - a) 2 - 4/3 
n, 2 = ^ '- (29.13) 

are both non-negative integers, say p and q, in which case the series solution 
is really just two terms 

y = a p t p + a q t q (29.14) 

When there is not a non-negative integer solution to (29.13) then (29.4) 
does not have a seris solution. □ 

The result we found in example 29.3 does suggest to us one way to solve 
the Cauchy-Euler method. What if we relax the restriction on equation 
29.10 that k be an integer. To see how this might come about, we consider 
a solution of the form 

y = x r (29.15) 
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for some unknown number (integer, real, or possibly complex) r. To see 
what values of r might work, we substitute into the original ODE (29.4): 

t 2 r(r - l)f- 2 + atrf- 1 + (3t r = 0 (29.16) 
=*> t r [r(r - 1) + ar + /?] = 0 (29.17) 

Since this must hold for all values of t, the second factor must be identically 
equal to zero. Thus we obtain 

r{r-l)+ar + f3 = Q (29.18) 



without the restriction that r € Z. We call this the indicial equation 
(even though there are no indices) due to its relationship (and similarity) 
to the indicial equation that we will have to solve in Frobenius' method in 
chapter 30. 

We will now consider each of the three possible cases for the roots 

n, 2 = ^ - (29.19) 



Case 1: Two real roots . If r\ , r<z € K and T\ ^ ^2 , then we have found two 
linearly independent solutions and the general solution is 

V = Cit ri + C 2 f 2 (29.20) 

Example 29.4. Find the general solution of 

2t 2 y" + My' -y = 0 (29.21) 

In standard from this becomes 

t 2 y" + \ty' -\y = ® (29.22) 



The indicial equation is 



Q = r{r-l)- i -r+ 1 -= 2 -r 2 + \r +\ (29.23) 
0 = 2r 2 + r + 1 = (2r - l)(r + 1) =^ r = i -1 (29.24) 



Hence 

t 



y = dVi+— □ (29.25) 
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Case 2: Two equal real roots. Suppose r± = r 2 = r. Then 

1 - a 



(29.26) 



because the square root must be zero (ie., (1 — a) 2 — 4/3 = 0) to give a 
repeated root. 

We have one solution is given by y\ = t r = t^ 1- ")/ 2 . To get a second 
solution we can use reduction of order. 



From Abel's formula the Wronskian is 
W = Cexp 



atdt\ 



( ' cxp ( — n I — 



Ce 



-a In t 



By the definition of the Wronskian a second formula is given by 
W = v\y 2 - y 2 y'i 



1 - a 



Equating the two expressions for W , 

(i (1 - Q)/2 ) y' 2 ~ t£ (^) (V" 1 "^ 2 ) = 



c_ 



V2 



l-a\ iC- 1 " 0 )/ 2 



t (l-a)/2~y2 tQ ^(l- Q )/2) 

a-l \ , _ C 

J % " t (l+a)/2 



C 



.'/2 



(29.28) 
(29.29) 

(29.30) 
(29.31) 
(29.32) 



This is a first order linear equation; an integrating factor is 



fj,(t) = exp 



a - 1 
2t 



dt I = exp 



a- 1 



lni) =t< a -W (29.33) 



If we denote = Ct _(1+Q )/ 2 then the general solution of (29.32) is 



1 

t (l-a)/2 



fj,(t)q(t)dt + Ci 

t ( a -l)/2 Ct -(l +a) /2 dt + Ci 



= c yi 



dt 



•Citfi 



C yi In |t| + C l2/1 



(29.34) 

(29.35) 

(29.36) 
(29.37) 
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because y 1 = t r = t (1 - a ^ 2 . 

Thus the second solution is y 2 = y\ln\t\, and the the general solution to 
the Euler equation in case 2 becomes 

y = Cxt r + C 2 t r In |i| □ (29.38) 

Example 29.5. Solve the Euler equation t 2 y" + hty' + Ay = 0. 
The indicial equation is 

0 = r(r - 1) + 5r + 4 = r 2 + 4r + 4 = (r + 2) 2 r = -2 (29.39) 

This is case 2 with r = —2, so y\ = 1/t 2 and y 2 = (l/i 2 )ln|i|, and the 
general solution is 

y = ^ + ^^\t\ n ( 2 9- 4 o) 

Case 3: Complex Roots. If the roots of t 2 y" + aty' + f3y — 0 are a complex 
conjugate pair then we may denote them as 

r = \±i( Jl (29.41) 
where A and fi are real numbers. The two solutions are given by 

t r = t \±i» = t \ t ±i» (29.42) 

= t x e ln ^ (29.43) 
= t A e ±i " ln * (29.44) 
= t x [cos(/i In t) ± i sin(^ In i)] (29.45) 

Hence the general solution is 

y = dt ri + C 2 t r2 (29.46) 
= C\t x [cos{n In i) + % sin(^i In t)] 

+ C 2 t A [cos(^lnt) - isin(/ilnt)] (29.47) 

= t A [(Ci + C* 2 ) cos(/ilnf) + (Ci - iC 2 ) sin(/xlni)] (29.48) 

Thus for any C\ and C 2 we can always find and A and (and vice versa), 
where 

A = C\ + C 2 (29.49) 

B = Ci - iC 2 (29.50) 

so that 

y = At A cos(/x In t) + Bi A sin(/z In t) (29.51) 
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Example 29.6. Solve t 2 y" + ty' + y = 0. The indicial equation is 

0 = r(r - 1) + r + 1 = r 2 + 1 r = ±i (29.52) 

Thus the roots are a complex conjugate pair with real part A = 0 and 
imaginary part fi = \. Hence the solution is 

y = At°cos(l • hit) + 5t°sin(l • hit) = ,4 cos hit + B sin hit □ (29.53) 

Summary of Cauchy-Euler Equation 

To solve t 2 y" + aty' + (3y = 0 find the roots of 

r(r -1) + ar + /3 = 0 (29.54) 
There are three possible case. 

1. If the roots are real and distinct, say n ^ r 2 , then the solution is 

y = C\t ri + C 2 t r2 (29.55) 



2. If the roots are real and equal, say r = t\ = r 2 , then the solution is 

y = C\t r + C 2 t r ln\t\ (29.56) 



3. If the roots form a complex conjugate pair r = \±i[i, where A,/teR, 
then the solution is 

y = Cit A cos(^ In t) + C 2 t x sin(^ In t) (29.57) 

where, in each case, C\ and C 2 are arbitrary constants (that may be 
determined by initial conditions). 
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Lesson 30 



The Method of Frobenius 



If the equation 

y" + b(t)y' + c(t)y = 0 (30.1) 
has a regular singularity at the point t = to, then the functions 

P (t) = (t - t 0 )b(t) (30.2) 

q{t) = (t - t Q ) 2 c(t) (30.3) 

are analytic at t = to (see the discussion following (28.65)). Substituting 
(30.2) and (30.3) into (30.1) and then multiplying the result through by 
(t - t 0 ) 2 gives 

(t - t 0 ) 2 y" + (t- t 0 )p(t)y' + q(t)y = 0 (30.4) 

Thus we are free to take equation (30.4) as the canonical form any second 
order differential equation with a regular singularity at t = to. By canonical 
form, we mean a standard form for describing any the properties of any 
second order differential equation with a regular singularity at t = to- 

The simplest possible form that equation (30.4) can take occurs when t 0 = 0 
and p(t) = q(t) = 1, 

t 2 y" + ty' + y = 0 (30.5) 
Equation (30.5) is a form of the Cauchy-Euler equation 

t 2 y" + aty' + by = 0 7 (30.6) 

where a and b are nonzero constants. The fact that theorem 28.1 fails 
to guarantee a series solution around t = 0 is illustrated by the following 
example. 
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Example 30.1. Attempt to find a series solution for equation (30.5). 

Following our usual procedure we let y — c kt k , differentiate twice, and 
substitute the results into the differential equation, leading to 

oo oo oo 

0 = t 2 Ckk(k - l)t k - 2 + t Y c k kt k ^ + ^2 c k t k (30.7) 

k=0 k=0 k=0 

oo oo oo 

= ^2 Ck k(k - i)t k + ^2 °kkt k + J2 Cktk ( 30 - 8 ) 

fc=0 k=0 k=0 

oo 

= J2c k (k(k-l) + k + l)t k (30.9) 

fe=0 
oo 

= ^c fc (fc 2 + l)t fe (30.10) 

fc=0 

By linear independence, 

c k (k 2 + 1)=0 (30.11) 

for all k. But since k 2 + 1 is a positive integer, this means c k = 0 for all 
values of k. Hence the only series solution is the trivial one, y = 0. □ 

Before one is tempted to conclude that there is no non-trivial solution to 
equation (30.5), consider the following example. 

Example 30.2. Use the substitution x — hit to find a solution to (30.5). 
By the chain rule 

, dy dx 1 dy , 
y=-r-r = --r 30.12) 
dx dt t dx 

Differentiating a second time, 

V"=i(' d l) (30-13) 

(30.14) 
(30.15) 
(30.16) 



dt \ t dx t 

1 dy 1 d f dy 

t 2 dx t dt \dx 

1 dy 1 d ( dy\ dx 

t 2 dx t dx \dx J dt 

1 dy 1 d 2 y 

t 2 dx t 2 dx 2 

Substituting (30.12) and (30.16) into (30.5) gives 

dx 



2 , y = 0 (30.17) 
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This is a homogeneous linear equation with constant coefficients; the solu- 
tion is 

y = C\ cos x + Ci sin x (30.18) 
= Ci cos In i + C 2 sin Int. □ (30.19) 

The solution we found to (30.5) in example 30.2 is not even defined, much 
less analytic at t = 0. So there is no power series solution. However, it 
turns out that we can still make use of the result we found in example 30.1, 
which said that the power series solution only "exists" when k 2 + 1 = 0, 
if we drop the requirement that k be an integer, since then we would have 
k = ±i, and our "series" solution would be 

y = Y^ c ^ k = c -* ri + c ^ (30.20) 
fees 

where the sum is taken over the set S = {— i, i}. 

Example 30.3. Show that the "series" solution given by (30.20) is equiv- 
alent to the solution we found in example 30.2. 

Rewriting (30.20), 

y = c-it'* + ci? (30.21) 

= c_ j exp In t~ % + ^ exp In f (30.22) 

= c_; exp(— i In t) + Ci exp(i In t) (30.23) 

= c_i[cos(— i hit) + ism(—i\ni)] + Ci[cos(i\nt) + isin(ilni)] (30.24) 

= c_i cos(i In t) — ic_i sin(i hit) + Cj cos(i In t) + ici sin(i hit) (30.25) 

= (cj + e_i) cos(i hit) + i(ci — c_i) sin(i hit) (30.26) 

= C 1 cos(i\nt)+C 2 sm(i\nt) (30.27) 

where 

Ci = c-i + Ci (30.28) 
C 2 = i{c t - c_ t ) (30.29) 

Since this is a linear system and we can solve for Ci and c_j, namely 

Ci=~(Ci-iC 2 ) (30.30) 
c- l = l -(C 1 + iC 2 ) (30.31) 

Given either solution, we can find constants that make it the same as the 
other solution, hence the two solutions are identical. □ 
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Since each term in (30.20) has the form t a for some complex number a, 
this led Georg Ferdinand Frobenius to look for solutions of the form 

y = (t-t Q ) a S(t) (30.32) 

where S(t) is analytic at ip an d can be expanded in a power series, 

oo 

S(t) = ^c fe (i-i 0 ) fe (30.33) 

fe=0 

To determine the condition under which Frobenius' solution works, we dif- 
ferentiate (30.32) twice 

y' = a(t - to) a ^S + (t - t Q ) a S' (30.34) 

y" = a(a - l)(t - t 0 ) a ~ 2 S + 2a(t - to^S' + (t - t Q ) a S" (30.35) 

and substitute equations (30.32), (30.34), and (30.35) into the differential 
equation (30.4): 

0=(t - t 0 ) 2 [a(a -l)(t - t 0 ) a -' 2 S + 2a(t - i 0 )" _1 5" + (t- i 0 ) Q 5"] 
+(t - t 0 ) [a(t - to^S +(t- t 0 ) a S'] P (t) + (t - t 0 ) a Sq{t) (30.36) 
={t - < 0 ) Q+2 S" + [2a + p(t)} (t - t 0 ) a+1 S' 
+ [a(a - 1) + ap(t) + q(t)} (t - t a ) a S (30.37) 

For t 7^ to, the common factor of (t — to) a can be factored out to and the 
result becomes 

0 = (t-to) 2 S" + [2a+p(t)} {t-t 0 )S' + [a(a - 1) + ap(t) + q(t)] S (30.38) 

Since p(t), q(t), and S(t) are all analytic at to the expression on the right- 
hand side of (30.38) is also analytic, and hence infinitely differentiable, at 
to. Thus it must be continuous at to (differentiability implies continuity), 
and its limit as t — > to must equal its value at t = to- Thus 

[a(a - 1) + ap{t 0 ) + q(t 0 )] S(t 0 ) = 0 (30.39) 

So either S(to) — 0 (which means that y(to) = 0) or 



a(a- 1) +ap(t 0 ) + q(t 0 ) = 0 (30.40) 



Equation (30.40) is called the indicial equation of the differential equation 
(30.4); if it is not satisfied, the Frobenius solution (30.32) will not work. 
The Indicial equation plays a role analogous to the characteristic equation 
but at regular singular points. 

Before we prove that the indicial equation is also sufficient, we present the 
following example that demonstrates the Method of Frobenius. 
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Example 30.4. Find a Frobenius solution to Bessel's equation of order 
1 /2 near the origin, 

t 2 y" + ty' + (t 2 - 1/4)2/ = 0 (30.41) 

By "near the origin" we mean "in a neighborhood that includes the point 
t 0 = 0. 

The differential equation has the same form as y" + b(t)y' + c(t)y = 0 with 
b(t) = 1/t and c(t) = (t 2 — l/A)/t 2 , neither of which is analytic at t = 0. 
Thus the origin is not an ordinary point. However, since 

p(t) = tb{t) = 1 (30.42) 

and 

q{t) = t 2 c(t) = t 2 - 1/4 (30.43) 

are both analytic at t = 0, we conclude that the singularity is regular. 
Letting to = 0, we have p(to) = p(0) — 1 and q(to) = —1/4, so the indicial 
equation is 

0 = a(a - 1) +a - ~ = a 2 - ~ (30.44) 
The roots are a = ±1/2, so the two possible Frobenius solutions 

oo oo 

yx = Vt J2 a kt k = «fe^ +V2 (30-45) 

fe=0 k=0 

V2 = ^ r Y J b k t k = jr bk t k - 1 / 2 (30.46) 
Starting with the first solution, 

oo 

y[ =Y j a k {k + l/2)t k - 1 ' 2 (30.47) 

A.:=0 
OO 

V" = ^a fc (fc 2 -l/4)i fe - 3 / 2 (30.48) 

k=0 

Using (30.45) and (30.47) the differential equation gives 

o = f> (e- \) t^ 2 +f> fk+l) t^ 2 

k=0 ^ ' fc=0 ^ ' 

- A )J2 a ^ tk+1/2 ( 30 - 49 ) 



+ 1 1 2 - 



k=0 
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Canceling the common factor of \fi, 

0 =f> (V-iy+f> (k+\)t k 

k=0 ^ ' k=0 ^ ' 

oo -.00 

+ Y,a k t k + 2 - -Y,a k t k (30.50) 

fe=0 k=0 

= ^ afc fc 2_l +fc+ l_l + ^ ajfct *-K> (30 . 51) 

^ ' fe=0 

00 00 

= J2 a k(k 2 + k) + Y,a k t k+2 (30.52) 

k=0 k=0 

Letting j = k + 2 in the second sum, 



0 = J2 a k(k 2 + k)t k + a 3-2t 3 (30.53) 

fc=0 j=2 



Since the k = 0 term is zero and the k = 1 term is 2ait in the first sum, 

00 

0 = 2aii + ^ [a, (j 2 + j) + Oj_ 2 ] * j (30.54) 
By linear independence, 

ai = 0 (30.55) 
°J = ^ff) ' 3 > 2 (30.56) 



Since a\ = 0, all subsequent odd-numbered coefficients are zero (this follows 
from the second equation). Furthermore, 
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Thus a Frobenius solution is 

oo 

yi = VtJ2 a kt k (30.58) 

k=0 

= Vi(a Q + ait + a 2 t 2 H ) (30.59) 

= ao^(l-7^ 2 + ^ 4 -^ 6 + ---) (30.60) 

ir3! + 5!-7! + -) (3 °- 61) 

= -^Lsint (30.62) 
yt 

Returning to the second solution 

V2 = %+ hVt + b 2 t 3 ' 2 + b 3 t 5 / 2 + ■■■ (30.63) 

This series cannot even converge at the origin unless b 0 = 0. This leads to 

y 2 = b l y r t + b 2 t" 2 + b z t b ' 2 + ■■■ (30.64) 

= Vt(6 a + b 2 t + b 3 t 2 + ■■■) (30.65) 

which is the same as the first solution. So the Frobenius procedure, in this 
case, only gives us the one solution. □ 

Theorem 30.1. (Method of Frobenius) Let 

OO 

p(t) = J2Pk(t-t 0 ) k and (30.66) 

k=0 

oo 

q(t)=Y,<lk(t-t 0 ) k (30.67) 

fe=0 

be analytic functions at t = to, with radii of convergence r, and let ai,a 2 
be the roots of the indicial equation 

a{a - 1) + ap(t 0 ) + q(t 0 ) = 0. (30.68) 

Then 

1. If ai, a 2 are both real and a = max{ai, a^}; there exists some set of 
constants {ai, a 2 , ...} such that 

oo 

y=(t-t a ) a Y j a k {t-t 0 ) k (30.69) 

fe=0 
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is a solution of 

(t - t 0 ) 2 y" + (t- t 0 )p(t)y' + q(t)y = 0 (30.70) 

2. If ai, ct2 are both real and distinct, such that A = a\ — a 2 is not an 
integer, then (30.69) gives a second solution with a = minjai, a^jand 
a (different) set of coefficients {a 1 ,a 2 , ■■■}■ 

3. If ai, cn2 are a complex conjugate pair, then there exists some sets of 
constants {oi, a,2, ■■■} and {&i, &2> •••} such that 



yi 



= (i-t 0 ) Ql 5>fc(i-*o) fe (30.71) 



fe=0 



y2 = (t-toT 2 J2 b k( t ~ t o) k (30.72) 

k=0 

form a fundamental set of solutions to (30.70). 
Example 30.5. Find the form of the Frobenius solutions for 

2t 2 y" + 7ty' + 3y = 0 (30.73) 
The differential equation can be put into the standard form 

t 2 y" + tp(t)y' + q(t)y = 0 (30.74) 

by setting p(t) — 7/2 and q(t) = 3/2. The indicial equation is 

0 = a 2 + (po - l)a + qo (30.75) 

= a 2 + (5/2)a + 3/2 (30.76) 

= (a + 3/2)(a + l) (30.77) 

Hence the roots are a% — — 1, 012 = —3/2. Since A = «i — «2 = 1/2 ^ Z, 
each root leads to a solution: 

_^ 00 

2/1 = - a * tk = y + ai + 02* + a 3 * 2 + ■ • • (30.78) 

fe=0 

k=0 
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Example 30.6. Find the form of the Frobenius solutions to 

t 2 y" -ty + 2y = 0 (30.80) 

This equation can be written in the form t 2 y" + tp(t)y' + q(t)y — 0 where 
p(t) = —1 and q(t) = 2. Hence the indicial equation is 

0 = a 2 + (po - l)a + q 0 = a 2 - 2a + 2 (30.81) 

The roots of the indicial equation are a = 1 ± i, a complex conjugate pair. 
Since Act = (1 + i) — (1 — i) = 2i ^ Z, each root gives a Frobenius solution: 



yi=t 1+t J2 a kt k (30.82) 

fe=0 

= (cos In t + i sin In t) (aot + a 1 t 2 + a 2 t 3 H ) (30.83) 

CO 

V2=t 1 ~ i J2 b kt k (30.84) 

k=0 

= (cos In t - isinlnf) (b 0 t + b 1 t 2 + b 2 t 3 + ■ ■ •) . □ (30.85) 

Example 30.7. Find the form of the Frobenius solution for the Bessel 
equation of order -3, 

t 2 y" + ty' + (t 2 + 9) = 0 (30.86) 

This has p(t) = 1 and q(t) = t 2 + 9, so that po = 1 and q 0 = 9. The indicial 
equation is 

a 2 + 9 = 0 (30.87) 

The roots are the complex conjugate pair ati = 3i, a 2 = For a 

complex conjugate pair, each root gives a Frobenius solution, and hence we 
have two solutions 

oo oo 

2/1 = t 3t a k t k = [cos(3 \nt)+i sin(3 In t)] ^ a kt k (30.88) 

fc=0 fe=0 
oo oo 

y 2 = t~ 31 Y b k t k = [cos(3 ]nt)-i sin(3 In t)} ^ 6 fc t fe (30.89) 

fc=0 fe=0 

where we have used the identity 

t te = e ix ln * = cos(a; In t) + i sin(x In t) (30.90) 
in the second form of each expression. □ 
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Proof, (of theorem 30.1). Suppose that 

y=(t-t Q ) a S(x) (30.91) 
is a solution of (30.70), where 

oo 

S=Y,c n (t-t 0 ) n . (30.92) 

n=0 

We will derive formulas for the Cfe. 

For n = 1, we start by differentiating equation (30.38) 

0=2(t-t 0 )S" + (t-t Q ) 2 S"' 
+ \p(t) + 2a] S' + (t- t 0 )p'(t)S' + (t- t 0 ) [p(t) + 2a] S'" 
+ [q'(t) + ap'(t)] S + [q(t) + a(a - 1) + ap(t)] S' (30.93) 

Everything on the right hand side of this equation is analytic, and hence 
continuous. Taking the limit as t — > t a , we have, 

0=[p(*o) + 2a] S' (t 0 ) 
+ [q'(t 0 ) + ap'{to)] S + [q{t 0 ) + a(a - 1) + ap(t 0 )] S'{t 0 ) (30.94) 

By Taylor's Theorem c„ = SW(t 0 )/n! so that c 0 = S(t 0 ) and ci = S'(t 0 ); 
similarly, p(t 0 ) = p 0 , p'(t 0 ) = pi, q(t 0 ) = q 0) and q'(t Q ) = qi in (30.66), and 
therefore 

0 = (po + 2a)ci + [qi + api]c 0 + [q 0 + a(a — 1) + ap 0 ]ci (30.95) 
The third term is zero (this follows from (30.68)) and hence 

cj = r^ c o- (30.96) 

Po + 2a 

For n > 1, we will need to differentiate equation (30.38) n times, to obtain 
a recursion relationship between the remaining coefficients, starting with 

0 = [(t - to) 2 S"] + DW {[2a+p(t)] [t - t 0 )S'} 

+ DM {[a(a - 1) + ap(t) + q(t)] S} (30.97) 

We then apply the identity 

D n (uv) = (fj (D k u)(D n - k v) (30.98) 
fe=0 ^ ' 
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term by term to (30.97). Starting with the first term, 

D n [(t - t 0 ) 2 S"] = (l) [ D ^ 1 ~ l o) 2 ] [D n - j S") (30.99) 



3=0 



(t-t a ) 2 D n S" + 2( n i \ (t-to)D 



i s ,, 



2 ' D n - 2 S" (30.100) 



n 
2 

Even for n > 2 there are only 3 terms because D n (t — to) 2 = 0 for n > 3. 
Hence 

D" [(f - i 0 ) 2 5"] = (t - t Q ) 2 S {n+2 '> + 2(n - l)(i - i 0 )S (n+1) 

+ n(n — l)S (,i) (30.101) 

At t = t 0 , 

D n [(< - t 0 ) 2 S"] | = n(n - l)S w (to) = »(« - l)c»n! (30.102) 
Similarly, the second term in (30.97) 
D n {(t-t 0 )[2a + p(t)]S'(t)} 

= £ ffe) ^-^"- fe {S'W[2a+p(i)]} (30.103) 
fe=0 ^ ' 

= (t - *o)D n {fif(t)[2a + p{t)}} + nD n ~ 1 {S'(t)[2a + p(t)}} (30.104) 
At t = t 0 , 

D n {(t-t 0 )[2a. + P (t)]S'(t)}(t 0 ) 

= nD 71 - 1 {S'(t)[2a +p{t)]} (t 0 ) (30.105) 
n— 1 / \ 

= n E Pfc {[2«+pW]W(t 0 )}5("-' £ )(io) (30.106) 
= n[2a+p(t Q )]St n \t 0 ) 

n-l 

+ 71 

fe=l 



]T r {[2a +J3 W] (fe) (io)}^ fe) (to) (30.107) 
fe=i ^ ' 

n[2 a +^o)]^ (n) (<o) + « E (' n fc 1 )p W (*o)S ,(n " k) (*b) ( 30 - 108 ) 
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By Taylor's theorem p^ito) = klp k and S^ n k \t 0 ) = (n ~ fc)!c n _fc, where 
Pk and Cfc are the Taylor coefficients of p(t) and S(t), respectively, 

Similarly, the third term in (30.97) is 
O w {[a(a - 1) + op(t) + g(t)] 5} (to) 

= E (fc) {["(« - !) + ^(*) + (*o)} ^ ( "" fe) (*o) (30.109) 

Extracting the first (k — 0) term, 

D (n) {[«(<* - 1) + op(<) + ?(*)] S} (*o) 
= [a(a - 1) + a Po + q 0 ] S^(t 0 ) 

+ E (fc) [«P W (*o) + q {k) (t 0 )] S^ n - k \t 0 ) (30.110) 

By the indicial equation, the first term is zero. Substituting the formulas 
for the Taylor coefficients and simplifying, 

0 (B) {[a(a - 1) + op(t) + g(t)] 5*} (to) = (k) [aklpk + klqk] ( n ~ fc ) !c «- fe 

k— 1 

(30.111) 

Substituting (30.111) and (30.102) into (30.97), 
0 =n(n — l)c n n\ + nnl(2a + po)c n 

n— 1 n 

+ ^ n! (" - k)p k c n - k + '^n\ [ap k + q k ] c„_ fc (30.112) 

k=l k=l 

Rearranging and simplifying, 

n-i 

n(n - 1 + 2a+p 0 )c n + ^[(n - fc + a)p fe + %]c n _ fe = 0 (30.113) 
fe=i 

Letting r > 0 be the radius of convergence of the Taylor series for p and 
q, then there is some number M such that \p k \ r k < M and \q k \ r k < M. 
Then 



n— 1 ^ 

(n-l + 2a+p 0 )c„| < M ^ [|n - k + a\ + 1] \cn- k \ (30.114) 



fc=i 



Define the numbers Cq = |cq| , C\ = \ci\, and, for n > 2, 



n-1 



M 1 

|n-l+2a+p 0 |C„ = — V-r[|n-fc + a| + l]C„_ fc (30.115) 



n f — ' r 

k=l 
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Let j = n — k. Then 



M 

1 + 2a+ Po \ C n = —V] r> [\j +a\ + l] C d 



n-1 



(30.116) 



Evaluating (30.116) for n + 1, 

\n + 2a+ Po \C n+1 = (n+ ff r „ +1 Ej=i ^ [U + «[ + 1] Cj 



(30.117) 



Therefore 

\n + 2a+p 0 \ C n+1 r(n + l) ={n\n-l + 2a + p 0 \ + M [\n + a\ + 1]}C„ 

(30.118) 

so that 



C n +i(t-t Q ) n\n-l + 2a+p 0 \+M[\n + a\ + l] (t-t 0 ) 



\n + 2a+p 0 \ (n+1) 

^2 r M -j (t - t 0 ) 



|r t +2a+p 0 |(n+l) 



Hence 



lim 

n— >oo 



C n +i(t — to) 




t-to 






r 



< 1 



(30.119) 
(30.120) 

(30.121) 



Therefore by the ratio test Y^k=o^ k ^ ~ ^o) k converges; by the compari- 
son test, the sum J2n°=o Cn (^ — t 0 ) n also converges. Equations (30.96) and 
(30.113) give formulas for the c n 



ci 



gi + api 
Po + 2a 



Co 



and 



-1 



n-l 



Cn = —, T~. -= . V ^2 K« ~ k + a )Pk + Ik] C n -k 

n(n - 1 + 2a + po) ^ 

so that 

oo 

y = (t-t 0 ) a J2 c "( t - t °) n 

n=0 

is a solution of (30.70) so long as 

n - 1 + 2a + po ^ 0. 



(30.122) 



(30.123) 



(30.124) 



(30.125) 



296 



LESSON 30. THE METHOD OF FROBENIUS 



By the indicial equation, a 2 + a(po — 1) + qo = 0, so that 
1 r 



a =2 



l- Po ± V^-Po) 2 -iqo\ (30.126) 
Designate the two roots by a+ and a_ and define 

A = a + - a_ = V(l-Po) 2 -4 9o (30.127) 
If they are real, then the larger root satisfies 2a+ > 1 — po, so that 

n - 1 + 2a + + po>n-l + l-p 0 +p 0 = n> 0 (30.128) 

Therefore (30.124) gives a solution for the larger of the two roots. The 
other root gives 



n-l + 2a_ +p Q = n-l + l-po- yj (p 0 - l) 2 - 4g 0 + Po 

(30.129) 

This is never zero unless the two roots differ by an integer. Thus the smaller 
root also gives a solution, so long as the roots are different and do not differ 
by an integer. 

If the roots are complex, then 

a=-[l-po±iA] (30.130) 

where A^0 and therefore 

n-l + 2a + po = n-l + l-po±iA + p 0 = n±iA (30.131) 
which can never be zero. Hence both complex roots lead to solutions. □ 

When the difference between the two roots of the indicial equation is an 
integer, a second solution can be found by reduction of order. 

Theorem 30.2. (Second Frobenius solution.) Suppose that p(t) and q(t) 
are both analytic with some radius of convergence r, and that a\ > oti are 
two (possibly distinct) real roots of the indicial equation 

a 2 + (p 0 -l)a + q 0 = Q (30.132) 

and let A = a\ — a%. Then for some set of constants {co, ci, ...} 

oo 

yi (t) = (t-t 0 ) ai Y, c k(t-to) k (30.133) 

fe=0 
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is a solution of 

(t - t 0 fy" + (t - t Q )p(t)y' + q{t)y = 0 (30.134) 

with radius of convergence r (as was shown in theorem 30.1), and a second 
linearly independent solution, also with radius of convergence r, is given by 
one of the following three cases. 

1. If ot\ — «2 = a, then 

oo 

y 2 = oyi(t) In \t - t 0 1 + (i - t 0 ) Q ^ a fc (t - t 0 ) fe (30.135) 

k=0 

2. If A e Z, then 

OO 

y 2 = a Vl {t) In \t - t 0 \ + (t - t 0 ) a2 ^k{t - t 0 ) k (30.136) 

fe=0 



3. If A £ Z, then 



y2 = (t-t 0 ) a *J2 a k( t ~ t o) k (30.137) 

fc=0 



for some set of constants {a, clq, oi, ...}. 

Proof. We only give the proof for i 0 = 0; otherwise, make the change of 
variables to x = t — <o and the proof is identical. Then the differential 
equation becomes 

t 2 y" + tp(t)y' + q(t)y = 0 (30.138) 
and the first Frobenius solution (30.133) is 

oo 

«(*) = #» 5^ cfct* (30.139) 

fc=0 

where a is the larger of the two roots of the indicial equation. By Abel's 
formula the Wronskian of (30.138) 



(30.140) 



where {po,p\, ...} are the Taylor coefficients of p(t). Integrating term by 
term 

W{t) = exp j-po In \t\ - p P ft k ^ = exp j- j (30.141) 



298 



LESSON 30. THE METHOD OF FROBENIUS 



Since 

,k 



e -" = l + £(-l) fe ^ (30.142) 

k=l 



we can write 

{oo ^ oo 

" 12 y* f = 1 + 12 aktk (30.143) 

k=l ) k=l 

for some sequence of numbers ai,a2, ■■■■ We do not actually need to know 
these numbers, only that they exist. Hence 

w{t) = \t\- po jl + ( 30 - 144 ) 

By the method of reduction of order, a second solution is given by 

i-po 



From equation (30.139), since u is analytic, so is 1/it, except possibly at its 
zeroes, so that 1/u can also be expanded in a Taylor series. Thus 



4) = raa {f> fe } = r " c o 2 1 1 + f> fe } 



(30.146) 



for some sequence 61,62, ■•■ Letting = 1/cq, 



u(t) = Jfu(i) y |tr P0_2Q |l + £M fc | 1 1 + £ «fc* fc J (30.147) 

for some sequence d\ , d% , . . . 
By the quadratic formula 

ai = \ (l - po + y/(l - Pa ) 2 - 4 9o ) = I (1 - po + A) (30.148) 

« 2 = ^ (l-po- V(l-Po) 2 -4 go ) = i(l-po-A) (30.149) 
and therefore 

2a+p 0 = l + A (30.150) 
since we have chosen a = max(ax, a^) = «i- Therefore 



dt (30.151) 
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Evaluation of the integral depends on the value of A. If A = 0 the first term 
is logarithmic; if A £ Z then the k = A term in the sum is logarithmic; 
and if A ^ Z, there are no logarithmic terms. We assume in the following 
that t > 0, so that we can set \t\ = t; the t < 0 case is left as an exercise. 

Case 1. A = 0 . In this case equation (30.151) becomes 



v(t) = Ku{t) 



= Ku(t) I In |t| + J2 d ' 



t k 



k=l 



Substitution of equation (30.139) gives 



k=0 



P 



fo\t\+J2 d n 



3 = 1 



OO oo 



Kt a In \t\ c k t k + Kt a J2Y^ °k d . 



t j+k 



fc=0 



k=0 j=l 



(30.152) 
(30.153) 



(30.154) 
(30.155) 



Since the product of two differentiable functions is differentiable, then the 
product of two analytic functions is analytic, hence the product of two 
power series is also a power series. The last term above is the product 
of two power series, which we can re-write as a single power series with 
coefficients ej as follows, 



v(t) = Kt a In |i| Y c kt k + Kt a Y e k t k (30.156) 

k=0 k=0 

oo 

= K\n\t\u(t)+t a ^e k t k (30.157) 



k=0 



for some sequence of numbers {eo,ei, ...}. This proves equation 30.135. 
Case 2. A = a positive integer. In this case we rewrite (30.151) as 



oo „ 

v(t) = Ku{t)^d k I t k -( 1+A *>dt 

k=0 J 



(30.158) 
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Integrating term by term, 



v(t) = Ku{t) 



d A Jr 1 dt+ jr d k Jt k ^ l+A Ut 



fe=0,fc#A 



Ku(t) 



oo , 

d A la|t| + £ 

fc=0,fc^A 

Substituting equation (30.139) in the second term, 

dk 



v(t) = au(t) In \t\ + Kt a £ c k t k £ 



k-A 



k-A 



(30.159) 
(30.160) 

(30.161) 



fc=0 k=0,k^£A 

where a is a constant, and we have factored out the common t~ A in the 
second line. 

Since the product of two power series is a power series, then there exists a 
sequence of numbers {eto, a\, ...} such that 



;(i) = au(t) In |i| + t a2 ]T a k t k 



(30.162) 



fc=0 



where we have used the fact that a-i = a — A. This proves (30.136). 
Case 3. A ^ 0 and A is not an integer. Integrating (30.151) term by term, 



v(t) = Ku(t) 



-A °° 

A f ^^A^ 

k=l 



(30.163) 
(30.164) 



fe=0 



where fo = —K/A and fk = Kdk/{k — A), for k — 1,2, .... Substitution 
for u(t) gives 

oo oo 

v(t) = t a - A c k t k fjt j (30.165) 

fe=0 j=0 

Since a 2 = a — A, and since the product of two power series is a power 
series, there exists some sequence of constants {ag, ai, ■■■} such that 



(30.166) 



fc=0 



which proves (30.137). □ 
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Example 30.8. In example 30.4 we found that one solution of Bessel's 
equation of order 1/2, given by 

t 2 y" + ty' + (i 2 - 1/4)2/ = 0 (30.167) 

near the origin is 

Vi = ^ (30.168) 

Find a second solution using the method of Frobenius. 

In example 30.4 we found that the the roots of the indicial equation are 

a x = 1/2 and a 2 = -1/2 (30.169) 

Since the difference between the two roots is 

A = a x - a 2 = 1 (30.170) 

We find the result from theorem 30.2, case 2, which gives a second solution 

oo 

1ft (*) =a yi {t)\n\t\ +t a2 J2 a k tk (30.171) 

The numbers a and ao,ai,... are found by substituting (30.171) into the 
original differential equation and using linear independence. In fact, since 
we have a neat, closed form for the first solution that is not a power series, 
it is easier to find the second solution directly by reduction of order. 

In standard form the differential equation can be rewritten as 

1 — 1/4 

y" + ~y' + t —^y = 0 (30.172) 

which has the form of y" +py' + q = 0 with p(t) = 1/y. By Abel's formula, 
one expression for the Wronskian is 

W = Cexp J ^dt = j (30.173) 

According to the reduction of order formula, a second solution is given by 

V* = I ^i* = ^ I 7 • (A) 2 * = ^ / esc 2 1 (30.174) 



Vi{t) 2 Vi J t \smtj Vt 

sin t cos t 
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Example 30.9. Find the form of the Frobenius solutions to Bessel's equa- 
tion of order 3, 

t 2 y" + ty + (t 2 - 9)y = 0 (30.176) 

Equation (30.176) has the form t 2 y" + tp(t)y' + q(t)y = 0, where p(t) = 1 
and q(t) = t 2 — 9 are both analytic functions at t = 0. Hence po = 1, 
go = —9, and the indicial equation a 2 + (po — l)a + qo = 0 is 

a 2 - 9 = 0 (30.177) 

Therefore ot\ — 3 and 012 = — 3. The first Frobenius solution is 

00 

yi =t z ^2 a k t k = a 0 t 3 + ai t 4 + a 2 t 5 H (30.178) 

fc=0 

Since A = «i - « 2 = 6 e Z, the second solution is 

00 00 
y 2 = a (hit) t 3 a k t k + r 3 ht k (30.179) 

k=0 fe=0 

The coefficients a, a k and b k are found by substituting the expressions 
(30.178) and (30.179) into the differential equation. □ 



Lesson 31 



Linear Systems 



The general linear system of order n can be written as 

y[ = cinyi + a 12 y 2 H h a ln + fi(t) " 

y' n = a mVi + a n2 y 2 H h a nn + f 2 (t) t 



(31.1) 



where the either constants (for systems with constant coefficients) or 

depend only on t and the functions fa (t) are either all zero (for homogeneous 
systems) or depend at most on t. 

We typically write this a matrix equation 



fan 012 



\a n i 




We will write this as the matrix system 

y' = Ay + f 



(31.2) 



(31.3) 



where it is convenient to think of y,f(t) : R — > M n as vector- valued func- 
tions. 

In analogy to the scalar case, we call a set of solutions to the vector equation 
{yi, ...,y n } to the homogeneous equation 



Ay 



(31.4) 
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a fundamental set of solutions if every solution to (31.4) can be written 
in the form 

y = C iyi (t) + ■ ■ ■ + C n y n (t) (31.5) 

for some set of constants Ci, . . . ,C n . We define the fundamental matrix 

as 

W=(yi ••• y„) (31.6) 
and the Wronskian as its determinant, 

W(t) = detW (31.7) 

The columns of the fundamental matrix contain the vector-valued solutions, 
not a solution and its derivatives, as they did for the scalar equation. 

However, this should not be surprising, because if we convert an nth order 
equation into a system by making the change of variables u\ = y, u% = y 1 , 
«3 = y", u n = y( n ~ l \ the two representations will be identical. 



Homogeneous Systems 

Theorem 31.1. The fundamental matrix of the system y' = Ay satisfies 
the differential equation. 

Proof. Let yi, y n be a fundamental set of solutions. Then each solution 
satisfies y[ = Ay$. But by definition of the fundamental matrix, 



W'=(yi ••■ y;) (31.8) 

= (Ayi • ■ • A]y„) (31.9) 

= A( yi ••• y n ) (31.10) 

= AW (31.11) 

Thus W satisfies the same differential equation. □ 



For n = 2, we can write equation the homo, 

U = au + bv 
v = cu + dv 

where u = yi , v = j/2) and a, b, c, and d art 
the characteristic equation of the matrix 



geneous system as 
| (31-12) 
; all real constants. 

(31.13) 
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is 

A 2 -TA + A = 0 (31.14) 

where 

T = a + d = trace(A) 1 

> 31.15 
A = ad-6c = dct(A)J V ' 

The roots Ai and A2 of (31.14) are the eigenvalues of A; we will make use 
of this fact shortly. 

By rearranging the system (31.12) it is possible to separate the two first 
order equations into equivalent second order equations with the variables 
separated. 

If both b — 0 and c = 0 , we have two completely independent first order 
equations, 

u = au, v = dv (31.16) 
If b 7^ 0, we can solve the first of equations (31.12) for v, 

v = i [v! - au] (31.17) 

Substituting (31.17) into both sides of the second of equations (31.12), 

- [u" — au'} = v' = cu + dv — cu + — [v! — au] (31.18) 

Rearranging, 

u" - (a + d)u' + (da - bc)u = 0 (31.19) 
If b = 0 and c ^ 0 the first of equations (31.12) becomes 



(31.20) 



and the second one can be solved for u, 



1 [v - dv] (31.21) 



Substituting (31.21) into (31.20), 



- c [v" - du'} =v! = au=^[v' - dv] (31.22) 

Rearranging, 

v" - {a + d)v' + adv = 0 (31.23) 
By a similar process we find that if c 7^ 0 

v" - (a + d)v' + (ad - bc)v = 0 (31.24) 
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and that if c = 0 but 6^0, 



u" - (a + d)v! + adu = 0 



(31.25) 



In every case in which one of the equations is second order, the character- 
istic equation of the differential equation is identical to the characteristic 
equation of the matrix, and hence the solutions are linear combinations of 
e Alt and e A2 *, if the eigenvalues are distinct, or are linear combinations of 
e At and te xt if the eigenvalue is repeated. Furthermore, if one (or both) the 
equations turn out to be first order, the solution to that equation is still 
e At where A is one of the eigenvalues of A. 

Theorem 31.2. Let 



Then the solution of y' = Ay is given be one of the following four cases. 
1. If b = c = 0, then the eigenvalues of A are a and d, and 




(31.26) 




(31.27) 



2. If b 0 but c = 0, then the eigenvalues of A are a and d, and 




> 



(31.28) 



C 3 e' 



,dt 



3. If b = 0 but c 7^ 0, then the eigenvalues of A are a and d, and 



yi = Cie' 



,dt 




> 



(31.29) 



4. If b 7^ 0 and c^0, then the eigenvalues of A are 




(31.30) 



and the solutions are 



(a) If Ai = A 2 = A 

yi = (Cn + C i2 t)e 



(31.31) 
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(b) If Ai ^ A 2 £ K, i.e., T 2 > 4A, 

Vl = C a e Xlt + C l2 e X2t (31.32) 

(c) It T 2 < 4A then Ai,2 = /z ± icr, where tr e K, and 

2/i = e^(Cii cos erf + C i2 sin erf) (31.33) 
Example 31.1. Solve the system 

y' = Ay, y(0)=(f) (31.34) 



where 

'1 1 

4 -2 



(31.35) 



by elimination of variables. 

To eliminate variables means we try to reduce the system to either two 
separate first order equations or a single second order equation that we can 
solve. Multiplying out the matrix system gives us 

u = u + v, uq = 6 (31.36) 
v' = Au~2v, v 0 = 5 (31.37) 

Solving the first equation for v and substituting into the second, 

v' = Au-2v = 4u- 2(u' - 11) =6u- 2u' (31.38) 

Differentiating the first equations and substituting 

u" = u' + v' = v! + 6u - 2v! = -u' + 6u (31.39) 

Rearranging, 

u" + u'-6u = Q (31.40) 
The characteristic equation is r 2 + r — 6 = (i — 2){r + 3) = 0 so that 

u = Cie 2t + C 2 e- 3t (31.41) 

From the initial conditions, u' a = uq + vq = 11. Hence 

C\ + C 2 = 6 (3142) 
2Ci-3C 2 = 11 {6 ' 

Multiplying the first of (31.42) by 3 and adding to the second gives 5Ci = 29 
or Ci = 29/5, and therefore C 2 = 6 - 29/5 = 1/5. Thus 
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29 e 2 * + I e " 3t 



5 5 

We can find v by substitution int (31.36): 



(31.43) 



V = u — u 

= — e zt - 
5 

- ^9 2t 
~ 5 



-3i 



29 



2/ 



e~ 3t a 



-31 



(31.44) 
(31.45) 

(31.46) 



The Matrix Exponential 



Definition 31.3. Let M be any square matrix. Then we define the expo- 
nential of the matrix as 



exp(M) 



I + M+^M 2 



1 

3! 



M 



1 

4? 



M 4 



(31.47) 



assuming that the series converges. 

Theorem 31.4. The solution of y' = Ay with initial conditions y(to) = yo 
is y = e A (*- t «)y 0 . 



Proof. Use Picard iteration: 

*o(*) = Yo 



Then 



**(*) =yo+ / A* fc _i(s)d. 

*i = yo + / A& 0 (s)ds 

J t 0 



yo 



Ay 0 ds 



t 0 



and in general 



y 0 + Ay 0 (t-t 0 ) 
[I + A(t - to)]y 0 



yo 



(31.48) 
(31.49) 

(31.50) 

(31.51) 

(31.52) 
(31.53) 

(31.54) 
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We will verify (31.54) by induction. We have already demonstrated it for 
k — 1 (equation 31.53). We take (31.54) as an inductive hypothesis and 
compute 



(31.55) 
(31.56) 



*fc+i(*)=yo + / A* fc (s)ds 

J t 0 

y 0 + f AIy 0 d,s +/V ^.A fc+1 ( S - t Q ) k y 0 ds (31.57) 
yo + AIy 0 (t - t 0 ) + V -^A fc+1 / (s - t 0 ) fe yods (31.58) 



3=1 



= yo 



3= 

fe+1 



y 0 + AIy 0 (t - t 0 ) + ^ ^A^i - t 0 )Jy 0 

fe+i ^ 

y 0 + ^-A^(t-to) 



3=2 ' 



3=1 
fe+1 



3=1 



yo 



(31.60) 
(31.61) 
(31.62) 



which completes the proof of equation (31.54). The general existence the- 
orem (Picard) then says that 



y = 



oo 1 



3=1 



yo 



(31.63) 



If we define a matrix M = A(t — to) and observe that M° = I, then 



oo 

m° +y -M fe 



3=1 



yo = e M yo = e A(t -* o) yo 



as required. 



(31.64) 



□ 
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Example 31.2. Solve the system 

y' = Ay where y(0) 

and 



From theorem 31.4 



y = e A(t-*o) yo = 



A = 



exp 



1 1 

4 -2 



1 1 

4 -2 



(31.65) 
(31.66) 

(31.67) 



The problem now is that we don't know how to calculate the matrix expo- 
nential! We will continue this example after we have discussed some of its 
properties. □ 

Theorem 31.5. Properties of the Matrix Exponential. 

1. If 0 is a square n x n matrix composed entirely of zeros, then 



e°=I 



(31.68) 



2. If A and B are square nxn matrices that commute (i.e., if AB = BA), 
then 

(31.69) 



e A + B = e A e B 



3. e is invertible, and 

(e A ) _1 =e- A (31.70) 

4. If A is any nxn matrix and S is any non-singular nxn matrix, then 

S~ 1 e A S = exp(S- 1 AS) (31.71) 

5. Let D = diag(xi, ...,x n ) be a diagonal matrix. Then 

e D = diag(e I1 ,...,e a: "). (31.72) 

6. If S _1 AS = D, where D is a diagonal matrix, then e A = Se D S _1 . 

7. If A has n linearly independent eigenvectors xi,...,x„ with corre- 
sponding eigenvalues Ai,...,A„, then e A = UEU -1 , where U = 
(xi,...,x„) and E = diag (e Al , e A ") . 



8. The matrix exponential is differentiable and ~^ eAt = Ae At . 
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The Jordan Form 



Let A be a square n x n matrix. 

A is diagonalizable if for some matrix U, U _1 AU = D is diagonal. 

A is diagonalizable if and only if it has n linearly independent eigenvectors 
vi, v„, in which case U = (vi • • • v„) will diagonalize A. 

If Ai,...,Afe are the eigenvalues of A with multiplicities mi,...,mt (hence 
n = mi + • • • + TOfc) then the Jordan Canonical Form of A is 



J = 



/ B i 

0 

Vo 



0 

B 2 



0 



0 



(31.73) 



where (a) if m, = 1, = Aj (a scalar or 1 x 1 matrix; and (b) if mi ^ 1, 
Bi is an mj x rrii submatrix with Ai repeated in every diagonal element, the 
number 1 in the supra-diagonal, and zeroes everywhere else, e.g., if = 3 
then 

Aj 1 0 \ 
B, = | 0 Ai 1 (31.74) 
0 0),/ 

The Bi are called Jordan Blocks. 

For every square matrix A, there exists a matrix U such J = U _1 AU 
exists. 

If J is the Jordan form of a matrix, then 



(31.75) 



/e B i 


0 0 \ 


0 


'•. 0 


V o 


0 e B «) 



Thus e A = UeJU- 1 . 

Example 31.3. Evaluate the solution 



e A(t ' to) yo 



cxp 



(31.76) 



found in the previous example. 
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The eigenvalues of A = 



1 1 

4 -2 



are A = 2,-3, which we find by solving 



the the characteristic equation. Let xi and x 2 be the eigenvectors of A. 
From the last theorem we know that 



(xi x 2 ) 



,2t 



0 



0 

,-3t 



(31.77) 



where Xi is the eigenvector with eigenvalue 2 and x 2 is the eigenvector with 
eigenvalue -3. 



Let x.,- = 
Then since Ax^ = AjXj, 



1 1 

4 -2 

1 1 

4 -2 



v 2 = -4u 2 



(31.78) 
(31.79) 



Since one component of each eigenvector is free, we are free to choose the 
following eigenvectors: 



Xl 



and x 2 



Let 



Then 



Therefore 



U" 1 



U = ( Xl x 2 ) = 
1 



1 

-4 



1 1 

1 -4 



dctU 



[cof(U)] J 



i A i 



5 V 1 - 4 

s(l -4 
1 / 4e 2t + e 



•21 



4e 2t 

c -3t 



-.3/, 



-3t 



5 \ 4e 2 ' - 4e~ 3 * e 2t 



-3t 



4e" 



4 1 
4 1 



„2t 



1 -1 

-4 4 



-3i 



(31.80) 

(31.81) 
(31.82) 

(31.83) 
(31.84) 
(31.85) 
(31.86) 



Hence the solution is 
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1 

5 
1 

5 

29 



4 1 
4 1 

29 
29 / 

1 



1 

-4 



1 



4 

-3t 



-3i 



1 

-4 



(31.87) 
(31.88) 
(31.89) 



We observe in passing that the last line has the form y = axie Al * + 6x 2 e A2 *. 
□ 



Properties of Solutions 

Theorem 31.6. y = e At v is a solution of the system y' = Ay if and only 
if v is an eigenvector of A with eigenvalue A. 

Proof. Suppose that {A,v} are an eigenvalue/eigenvector pair for the ma- 
trix A. Then 

Av = Av (31.90) 

and 

j t (e At v) = Ae At v = e At Av = A (e At v) (31.91) 
Hence y = e At v is a solution of y' = Ay. 

To prove the converse, suppose that y = e At v for some number A € C and 
some vector v, is a solution of y' = Ay. Then y = e A *vmust satisfy the 
differential equation, so 

Ae At v = y' = Ay = Ae At v (31.92) 

Dividing by the common scalar factor of e A *, which can never be zero, gives 
Av = Av. Hence A is an eigenvalue of A with eigenvector v. □ 

Theorem 31.7. The matrix e A * is a fundamental matrix of y' = Ay. 
Proof. Let W = e At . From the previous theorem, 

W = j t e At = Ae At = AW (31.93) 
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Let yi, ...,y n denote the column vectors of W. Then by (31.93) 

(yi • 



Equating columns, 



= w 

= AW 

= A (yi • • • y n ) 
= (Ay a • • • Ay„ 



y! = A y tI i = l,...,n 



(31.94) 
(31.95) 
(31.96) 
(31.97) 



(31.98) 



,,A' 



hence each column of W is a solution of the differential equation. 

Furthermore, by property (3) of of the Matrix Exponential, W = e"~" is 
invertible. Since a matrix is invertible if and only if all of its column vectors 
are linearly independent, this means that the columns of W form a linearly 
independent set of solutions to the differential equation. To prove that they 
are a fundamental set of solutions, suppose that y(t) is a solution of the 
initial value problem with y(io) = yo- 

We must show that it is a linear combination of the columns of W. Since 
the matrix W is invertible, the numbers Ci, C2, C„, which are the com- 
ponents of the vector 



C= [W(t 0 )P yo 



exist. But 



* = WC 



= yi • 



Yn) 



Cm 



\c nj 

' C n y n 



(31.99) 

(31.100) 
(31.101) 
(31.102) 



is a solution of the differential equation, and by (31.99), >&(£o) = W(to)C = 
yo, so that ^(t) also satisfies the initial value problem. By the uniqueness 
theorem, y and *&(t) must be identical. 

Hence every solution of y' = Ay is a linear combination of the column 
vectors of W, because any solution can be considered a solution of some 
initial value problem. Thus the column vectors form a fundamental set of 
solutions, and hence W is a fundamental matrix. □ 
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Theorem 31.8. (Abel's Formula.) The Wronskian of y' = Ay, where A 
is a constant matrix, is 

W(t) = J^ 0 ) e (*-*o)trace(A) (31.103) 

If A is a function of t, then 

W(t) = W(t 0 ) exp [ [trace(A(s))]ds (31.104) 

J t 0 



Proof. Let W be a fundamental matrix of y' = Ay. Then by the formula 
for differentiation of a determinant, 



W'(t) 



2/n 2/2i 

2/12 2/22 
2/13 2/2n 



2/nl 
2/n2 



+ ••• + 



2/n 2/2i 

2/l2 2/22 



2/13 2/2n 

2/n 2/21 • 
2/12 2/22 



2/13 V'ln 



■ 2/nl 
2/«2 

Unn 
Unl 



linn 



(31.105) 



But since W satisfies the differential equation, W = AW, so that 



/ an 



W = AW 



ain\ 



(yi • • • y n ) 



/ai-yi ••• ai-y„ x 
\a„ • yi • • • a„ • y„ 



(31.106) 



(31.107) 



where a^ is the zth row vector of A, and the a^ • yj represents the vector 
dot product between the i th row of A and the jth solution vector yj . 
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Comparing the last two results, 



W'(t) 



ai • yi ai • y 2 • • • ai • y„ 

2/12 2/22 Un2 



2/13 



2/2r, 



+ ••• + 



2/ii 

yi2 



2/21 
2/22 



2/n 2/21 
a 2 • yi a 2 • y 2 



2/13 2/2, 
Vnl 



a„ • yi a„ • y 2 



a„ • y r 



Vm 
a 2 • y„ 



(31.108) 



The first determinant is 



ai • yi 

2/12 
2/13 



ai • y„ 

2/n2 
2/rm 



auyu H h ai„j/i„ suKi H h ai„y 2 „ 

2/12 2/22 



2/13 



(31.109) 



a\\Vn\ H 1- a ln y nn 

Vn2 
Vnn 



We can subtract a 21 times the second row, a 31 times the third row, 
a n i times the nth row from the first row without changing the value of the 
determinant, 



ai • yi ai • y 2 

2/12 2/22 



ai • y n 

Vn2 



2/13 



2/2n 



aii2/n 

2/12 
2/13 



an2/2i 

2/22 
2/2n 



We can factor out an from every element in the first row, 



ai • yi ai y 2 

2/12 2/22 



ai • y- n 

2/n2 



2/13 



2/2r, 



an 



2/n 2/21 

2/12 2/22 
2/13 2/2n 



2/nl 
2/n2 



ailj/nl 
2/«2 



Unn 

(31.110) 



= anW(t) 
(31.111) 
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By a similar argument, the second determinant is a,22W(t), the third one 
is a^W(t), and the nth one is a nn W(t). Therefore 

W'(t) = (an + a 22 + • • • + a nn )W(t) = (traceA)W(t) (31.112) 
Dividing by W(t) and integrating produces the desired result. □ 

Theorem 31.9. Let yi, ...,y„ : / — > R" be solutions of the linear system 
y' = Ay, where A is an n x n constant matrix, on some interval / C K, 
and let W{t) denote their Wronskian. Then the following are equivalent: 

1. W(t) ^ 0 for all t E I. 

2. For some t 0 G /, W(t 0 ) ^ 0 

3. The set of functions yi(i), ...,y n (t) are linearly independent. 

4. The set of functions yi(t), y n (t) form a fundamental set of solutions 
to the system of differential equations on /. 

Proof. (1) (2). Suppose W{t) ^ 0 for all i e / (this is (1)). Then pick 
any t a e I. Then 3i 0 € / such that W(t 0 ) 7^ 0 (this is (2)). 

(2) (1). This follows immediately from Abel's formula. 

(1) => (3). Since the Wronskian is nonzero, the fundamental matrix is in- 
vertible. But a matrix is invertible if and only if its column vectors are 
linearly independent. 

(3) (1). Since the column vectors of the fundamental matrix are linearly 
independent, this means the matrix is invertible, which in turn implies that 
its determinant is nonzero. 

(3) => (4). This was proven in a previous theorem. 

(4) =>■ (3). Since the functions form a fundamental set, they must be linearly 
independent. 

Since (4) (3) (1) (2) all four statements are equivalent. 

□ 

Theorem 31.10. Let A be an n x n matrix with n linearly independent 
eigenvectors vi, v„ with corresponding eigenvalues Ai, A„. Then 

yi =v 1 e Al *,...y n -v n e A " t (31.113) 

form a fundamental set of solutions for y' = Ay. 
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Proof. We have show previously that each function in equations (31.113) is 
a solution of y' = Ay. Since the eigenvectors are linearly independent, the 
solutions are also linearly independent. It follows that the solutions form a 
fundamental set. □ 



Generalized Eigenvectors 



As a corollary to theorem 31.10, we observe that if A is diagonalizable 
(i.e. it has n linearly independent eigenvectors) then the general solution 
of y' = Ay is 



(31.114) 



If the matrix is not diagonalizable, then to find the fundamental matrix we 
must first find the Jordan form J of A, because 



3 A = Ue J U" 1 



(31.115) 



where J = U _1 AU for some matrix U that we must determine. If A were 
diagonalizable, the columns of U would be the eigenvectors of A. Since the 
system is not diagonalizable there are at least two eigenvectors that share 
the same eigenvalue. 

Let J = U 1 AU be the Jordan Canonical Form of A. Then since A = UJU -1 , 
we can rearrange the system of differential equations y' = Ay as 



y' = Ay = UJU V 
Uz' 



(31.116) 



Let z = U -1 y- Then 

y' = UJz (31.117) 

Multiplying through by U -1 on the left, we arrive at the Jordan form of 
the differential equation, 

z' = Jz (31.118) 

where J is the Jordan Canonical Form of A. Hence J is block diagonal, 
with each block corresponding to a single eigenvalue A.; of multiplicity mj. 
Writing 



z' = Jz = 



0 

V o 



0 

B 2 



0 \ 



(31.119) 
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we can replace (31.118) with a set of systems 



Z- = B,;Z; = 



/A, 1 0 0 \ 

o a,- ■■. ; 



V o 



•• 1 

0 Xi j 



(31.120) 



where is an rrii x nii matrix (mi is the multiplicity of A^). Starting with 
any block, denote the components of %i as £i, £2, £ TO , and (for the time 
being, at least) omit the index i. Then in component form, 



Ci =ACi + C2 
C 2 =AC 2 + Cs 



(31.121) 
(31.122) 



Cn-l — ACn-1 + Cn 
Cn =AiCn 



(31.123) 
(31.124) 



We can solve this type of system by "back substitution" - that is, start 
with the last one, and work backwards. This method works because the 
matrix is upper-triangular. The result is 



where ax, ...,a m are arbitrary constants. Rearranging, 

+ a 2 t + ■■■ + a m (l^yy \_ 



I C1 ^ 


( 


C2 




V Cm J 





hence 



z = aie 



0 



a 2 e 



1 
0 



+ h a m e 



J 



V 1 / 



(31.125) 



(31.126) 



(31.127) 



Denoting the standard basis vectors in M. m as ei,...,e m , 



320 



LESSON 31. LINEAR SYSTEMS 



z = aie At ei + a 2 e xt (e 2 + ei*) + a 3 e xt ^e 3 + e 2 t + ^t 2 ^ + 

+ • • • + a m e xt f e m + e m - X t +■■■ + e i ( m _ 1)1 ) (31.128) 

Definition 31.11. Let (A, v) be an eigenvalue-eigenvector pair of A with 
multiplicity m. Then the set of generalized eigenvectors of A corre- 
sponding to the eigenvalue A are the vectors Wi, ...,w m where 

(A - AI) fc w /c = 0, fc = l,2,...,m (31.129) 

For k — 1, equation (31.129) gives 

0 = (A - AI)wi = Awi - Awi (31.130) 

i.e., 

wi=v (31.131) 

So one of the generalized eigenvectors corresponding to the eigenvector v is 
always the original eigenvector v itself. If m = 1, this is the only generalized 
eigenvector. If m > 1, there are additional generalized eigenvectors. 

For k = 2, equation (31.129) gives 

0 = (A - AI) 2 w 2 (31.132) 

= (A — AI)(A — AI)w2 (31.133) 

= A(A - AI)w 2 - A(A - AI)w 2 (31.134) 

Rearranging, 

A(A - AI)w 2 = A(A - AI)w 2 (31.135) 

Thus (A — AI)w 2 is an eigenvector of A with eigenvalue A. Since Wi = v is 
also an eigenvector with eigenvalue A, we call it a generalized eigenvector. 
Thus we also have, from equation 31.135 and 31.129 

(A - AI)w 2 = wi (31.136) 

In general, if the multiplicity of the eigenvalue is m, 

(A-AI)wi=0 (31.137) 
(A-AI)w 2 = wi (31.138) 

(A - AI)w m = w ro _i (31.139) 
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Corollary 31.12. The generalized eigenvectors of the m x m matrix 



/ A 1 0 0 \ 

B= OA'".: 

: '•• "-. 1 
V 0 ••• 0 A / 

are the standard basis vectors e 1; e 2 , ...,e m . 



(31.140) 



Proof. 



(B - AI)ei = Aei - Ae x = 0 (31.141) 

(B - AI)e 2 = Be 2 - Ae 2 (31.142) 

= (1, A, 0, ... , 0) T - (0, A, 0, ... , 0, ) T = ei (31.143) 

(B - AI)e 3 = (0, 1, A, 0 ... , 0) T - (0, 0, A, 0, ... , 0) T = e 2 (31.144) 



(B - AI)e m = (0, . . . , 0, 1, A)) T - (0, . . . , 0, 1, 0) T = e m _! (31.145) 

□ 



Returning to equation (31.128), which gave the solution z of the ith Jordan 
Block of the Jordan form z' = Jz of the differential equation, we will now 
make the transformation back to the space of the usual y variable, using 
the fact that y = Uz 

y = Uz (31.146) 
= aie At W! + a 2 e xt (w 2 + Wii) 

/ £TO-1 \ 

+ • • • + a m e xt w m + w m _it + ■ ■ ■ + wi t — (31.147) 



(m - 1)! 
where 

Wj = Ue 4 (31.148) 

are the generalized eigenvectors of A. This establishes the following theo- 
rem. 
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Theorem 31.13. Let Ai, A2, \j be the eigenvalues of A correspond- 
ing to distinct, linearly independent, eigenvectors vi,...,Vj. Denote the 
multiplicity of eigenvalue Ai by fcj, for i = 1,2, (i.e., = n). Let 

Wji, • • • , Wjj be the generalized eigenvectors for A^, with w^i = Vi. Then a 
fundamental set of solutions to y' = Ay are 

y»i 

Yi3 



= w a e Xit (31.149) 
= N 1 +w, 2 )e A '' (31.150) 

= (|"Wii + tw 42 + w i3 ) e A ' 4 (31.151) 



' x (fci - m)! 



w m e 



A,/ 



Example 31.4. Solve 

y' = 

The characteristic polynomial is 
0 = 



3 3 
0 3 



3 - A 3 
0 3- A 



(3 - A) 2 



(31.152) 



(31.153) 



(31.154) 



which has A = 3 as a solution of multiplicity 2. Letting y^j denote the 
eigenvector, 

3 \ I a 



0 3 



(31.155) 



which can be decomposed into the following pair of equations 

3a + 36 = 3a 
3o = 36 



(31.156) 



Hence there is only one: eigenvector corresponding to A = 3, namely (any 
multiple of) (1 0) T . Therefore one solution of the differential equation is 



yi = ve At = 



„3t 



and a second, linearly independent solution, is 

y 2 = (tv + w 2 )e 3t 



(31.157) 



(31.158) 
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where (A — AI)w 2 = Wi, i.e., 



on-;;— ;i <»•«»> 



Letting w 2 = 1^1, this simplifies to 



0 3Wc Wl 
0 0 ) \ d ) 0 



(31.160) 



which gives d = 1/3 and leaves c undetermined (namely, any value will do, 



so we choose zero). Hence w 2 



y 2 = e 3t 



e 3t 



i 

1/3 



(31.161) 



The general solution is then 



y = ciyi+c 2 y 2 (31.162) 



where c\ and c 2 are arbitrary constants, qed 

Variation of Parameters for Systems 

Theorem 31.14. A particular solution of 

y' = Ay + g(£) (31.164) 

is 

y P = e At J e- At g(t)dt (31.165) 

Proof. Let W be a fundamental matrix of the homogeneous equation 
y' = Ay, and denote a fundamental set of solutions by yi, ...,y„. We will 
look for a particular solution of the form 

n 

yp = Y, yi(*)«*(*) = Wu (3i.i66) 

i=i 
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for some set of unknown functions ui(t), u„{t), and u = (tti(i) u<z(t) ■■■ u n {t)) T . 
Differentiating (31.f66) gives 

y' P = (Wu)' = W'u + Wu' (31.167) 

Substitution into the differential equation (31.164) gives 

W'u + Wu' = AWu + g (31.168) 

Since W = AW, 

AWu + Wu' = AWu + g (31.169) 
Subtracting the commong term AWu gives 

Wu' = g (31.170) 

Multiplying both sides of the equation by W _1 gives 

^=u' = W- 1 g (31.171) 

Since W = e At , W _1 = e~ At , and therefore 

u(i) = J ^dt = J e- At g{t)dt (31.172) 

Substition of (31.172) into (31.166) yields the desired result, using the fact 
that W = e At . □ 



Example 31.5. Find a particular solution to the system 

(31.173) 



x' = x + 3y + 5 
y' = Ax - 3y + 6t 



The problem can be restated in the form y' = Ay + g where 

A = (\ _ 3 3 ) , and g(t) = ( g t ) ( 31 ' 174 ) 
We first solve the homogeneous system. The eigenvalues of A satisfy 

0 = (1 - A)(— 3 - A) — 12 (31.175) 
= A 2 + 2A-15 (31.176) 
= (A-3)(A + 5) (31.177) 
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so that A = 3,-5. The eigenvectors satisfy 



1 3 

4 -3 



= 3 



and 



1 3 

4 -3 



2a = 36 => v 3 



-2c v_ 5 



1 

-2 



Hence 



Yh = cie 



3/ 



+ c 2 e 



-3/ 



1 

-2 



(31.178) 



(31.179) 



(31.180) 



where c\, C2 are arbitrary constants. Define a matrix U whose columns are 
the eigenvectors of A. Then 



»-0 -0- 4 "-'-($ -vO 



Then 



e A * = Ue^U- 1 
where D = diag(3, —5). Hence 



'3 1 

v 2 -2 

'3 1 

v 2 -2 

'3 



e 3t 0 \ /1/4 1/8 



0 e 



-5i 



e 3t /4 



1/4 -3/8 
/8 > \ 



*/4 -3e- 5t /8 y 
3 e 3* _ 3 e -5t 



-e 3t e~ 5t -e 3t + -e 

v 2 2 4 4 



5/ 



Since 
we have 



e- At = (Ue^U- 1 )- 1 = Ue- ut U 



DtjT-1 



-At 



0 \ A/4 1/8 \ 









-3t 






c 


0 




-3t + 


1 

r 


,5t 




-3t _ 




,5t 


\2 £ 




2' 





„5t 



1/4 -3/8 y 



3 e -3t _ 3 e5t 



e~ 3t + -e 



5/ 



(31.181) 
(31.182) 

(31.183) 
(31.184) 

(31.185) 

(31.186) 

(31.187) 
(31.188) 
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By the method of variation of parameters a particular solution is then 



y P = e At / e At g(t)dt (31.189) 



At f fh- 3t + \e 5t |e" 3 * - §e 5t \ / 5 \ , ... 1 Qn , 

- e J (j e -« _ | e5t | e -« + | e 5 f J J * (31-190) 

Using the integral formulas / e at dt = \e at and J te at dt — (t/a — 1/a 2 ) e at 
we find 



^e 5 * + f f * _ i e -3* _ 9 ft _ l \ e 5t 



= i,. ( ii-.-.i' li.Vi' 4 (-3 9) e 4 (5 _>-■ 



e 



2(-3)° 2(5)° ^2 V -3 9 J ^ T 2 15 25/ 

, _3„-3i i 17 5f _ 3t ~ 3f _ 9t 5t 
At I 2 e ' _50 e 4 e 20 e 



-3t _ If 5t _ * „-3t , 9t 5t 
e 25 e 2 e "r" 10 e 



Substituting equation (31.183) for e 



a; 



(31.191) 




y = y ff + yp (31.193) 

= Cl e 3t f J ) +c 2 e- 5t f * U ( "§ ~ t) (31.194) 



In terms of the variables x and ?/ in the original problem, 

29 6 

x = 3cie 3 * + c 2 e- 5t - — - v t (31.195) 
25 5 

42 2 

y = 2 Cl e 3i - 2c 2 e~ 5t + -t □ (31.196) 

25 5 
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Non-constant Coefficients 



We can solve the general linear system 

y'=A(t)y(i)+g(i) 



(31.197) 



where the restriction that A be constant has been removed, in the same 
manner that we solved it in the scalar case. We expect 



M(t) = exp 



A(t)dt 



to be an integrating factor of (31.197); in fact, since 

M'(i) = -M(t)A(t) 

we can determine 

d 



dt 



(M(t)y)=M(*)y , + M'(i)y 

= M(*)y' - M(t)A(i)y 
= M(t)(y'-A(t)y(t)) 
= M(t)g(t) 



Hence 



M(t)y = / M(t)g(t)dt + C 
and therefore the solution of (31.197) is 

y = M-\t) jM(t)g(t)dt + C 

for any arbitrary constant vector C. 

Example 31.6. Solve y' = A(t)y + g(t), y(0) = y 0 , where 



A = 



0 -t 

-t 0 



t 

3f 



yo = 



(31.198) 

(31.199) 

(31.200) 

(31.201) 
(31.202) 
(31.203) 

(31.204) 
(31.205) 



(31.206) 



To find the integrating factor M = exp J —A(t)dt, we first calculate 



P(t) = 

The eigenvalues of P are 



A(t)dt 



1 ( 0 t 2 
t 2 0 



Ai 



t 2 t 2 
2' X2= 2 



(31.207) 



(31.208) 
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The corresponding eigenvectors are 













I 1 


, V 2 = ( 


1 



(31.209) 



The diagonalizing matrix is then 



S = (vi v 2 ) = I - 1 \ 1 (31.210) 



and its inverse is given by 

8--K-, 1 ;) (31.21D 

so that 

D = S- 1 PS = i(- ( J 2 °) (31.212) 
is diagonal. Hence M = e p = Se D S~ 1 , which we calculate as follows. 

--(?i)( r r 

i / -1 1 \ / -e-* 2 / 2 e-* 2 /2 \ 

~ H 1 1 / v e ' 2/2 e ' 2/2 / 

1 / e-* 2 / 2 + e t2 / 2 -e-* 2 / 2 + e * 2 / 2 \ 

2 ^ - e -* 2 /2 +e t 2 /2 e -t 2 /2 +e t 2 /2 J 

cosh(t 2 /2) smh(i 2 /2) 
sinh(i 2 /2) cosh(i 2 /2) 

and (using the identity cosh 2 x — sinh 2 x = 1), 

M-=f COSh (f/% -^f/^ ) (31-214) 
V -sinh(r/2) cosh(r/2) ' 



(31.213) 



Furthermore, 



-<«o - ( S r^, ) ( i ) (3i.-) 

icosh(t 2 /2)+3tsinh(t 2 /2) \ 

isinh(i 2 /2) + 3tcosh(t 2 /2) ) ^i.^iOj 
Using the integral formulas 

y tcosh(t 2 /2)rft = sinh(t 2 /2) (31.217) 

y tsinh(t 2 /2)dt = cosh(t 2 /2) (31.218) 
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wc find that 



hence 



M" 1 ^) J M(t)g(t)dt (31.220) 



cosh(i 2 /2) - sinh(i 2 /2)\ /3 cosh(t 2 /2) + sinh(t 2 /2) x 
-sinh(i 2 /2) cosh(t 2 /2) ) l v cosh(t 2 /2) + 3 sinh(t 2 /2) / 



Since y = M _1 (i) [/ M(t)g(t)dt + C] , the general solution is 



The initial conditions give 



4 \ / 3 + Ci 
2 { l + C 2 



Hence C\ — C 2 — 1 and 



Since 



we have the solution of the initial value problem as 



(31.221) 
(31.222) 



3\ / cosh(i 2 /2) -sinh(t 2 /2)\ (CA . , 

l) + ^-sinh(t 2 /2) cosh(t 2 /2) ) \C 2 ) (31.^3) 

3 + Ci cosh(t 2 /2) - C 2 sinh(t 2 /2)\ 
1 - Ci sinh(t 2 /2) + C 2 cosh(t 2 /2) J 



(31.225) 



3 + cosh(t 2 /2) - sinh(t 2 /2) . 
l-sinh(t 2 /2) + cosh(t 2 /2) I (■..!..__(,) 



coshx-sinhx= — ^- =e" x (31.227) 



y=(i + e-^J- D (3L228) 



Lesson 32 



The Laplace Transform 



Basic Concepts 

Definition 32.1 (Laplace Transform). We say the Laplace Transform 

of the function fit) is the function F(s) defined by the integral 



C[f(t)] = F(s)= f 
Jo 



e- st f(t)dt 



(32.1) 



provided that integral exists. 

The notation C[f(t)] and F(s) are used interchangeably with one another. 

Example 32.1. Find the Laplace Transform of /(t) = t. 

Solution. From the definition of the Laplace Transform and equation A. 53 



C[t] = / te~ st dt 
Jo 

t 1 



□ 



(32.2) 
(32.3) 
(32.4) 



Example 32.2. Find the Laplace Transform of fit) = e 2 
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Solution. From the definition of the Laplace Transform 

C[e 2t ] = / e 2t e~ st dt= e^*dt (32.5) 
Jo Jo 



1 c f2-s)f 



2-s 
1 



(32.6) 



2 so long as s > 2 □ (32.7) 

Remark. As a generalization of the last example we can observe that 

C\e at ] = — , s > a (32.8) 

s — a 

Definition 32.2 (Inverse Transform). If F(s) is the Laplace Transform of 
f(t) then we say that f(t) is the Inverse Laplace Transform of F(s) and 
write 

f(t)=£- 1 [F(s)] (32.9) 

Example 32.3. From the example 32.1 we can make the following obser- 
vations: 

1. The Laplace Transform of the function f(t) = t is the function 
£[/(<)] = l/s\ 

2. The Inverse Laplace Transform of the function F(s) = 1/s 2 is the 
function fit) = t. 

In order to prove a condition that will guarantee the existence of a Laplace 
transform we will need some results from Calculus. 

Definition 32.3 (Exponentially Bounded). Suppose that there exist some 
constants K > 0, a, and M > 0, such that 

\f(t)\<Ke at (32.10) 

for all t > M. Then f(t) is said to be Exponentially Bounded. 

Definition 32.4 (Piecewise Continuous). A function is said to be Piece- 
wise Continuous on an interval (a, b) if the interval can be partitioned 
into a finite number of subintervals 

a = t 0 < h < t 2 < ■ ■ ■ < t n = b (32.11) 

such that f(t) is continuous on each sub-interval (t^, t-t+i) (figure 32). 
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Figure 32.1: A piecewise continuous function. This function is piecewise 
continuous in three intervals [—1, 1/2], [1/2, 3/2], [3/2, 2] and the function 
approaches a finite limit at the endpoint of each interval as the endpoint is 
approached from within that interval. 



2r 



z 

3 
2 

1 


• 


° T 




2 
1 


1 1 1 2 

2 1 2 * 



Theorem 32.5 (Integrability) . If f(t) is piecewise continuous on (a, 6) 
and /(£) approaches a finite limit at the endpoint of each interval as it is 
approached from within the interval then f(t)dt exists, i.e., the function 
is integrable on (a,b). 

Theorem 32.6 (Existence of Laplace Transform). Let f(t) be defined for 
alH > 0 and suppose that f(t) satisfies the following conditions: 

1. For any positive constant A, f(t) is piecewise continuous on [0,A]. 

2. f(t) is Exponentially Bounded. 

Then the Laplace Transform of f(t) exists for all s > a. 

Proof. Under the stated conditions, / is piecewise continuous, hence inte- 
grable; and \f(t)\ < Ke at for some K,a,M for all t > M. Thus 

roc 

C[F(t)] - / e- st f(t)dt (32.12) 

pM poo 

= / e- st f(t)dt+ / e- st f(t)dt (32.13) 
Jo Jm 

Since / is piecewise continuous, so is e~ st f(t), and since the definite integral 
of any piecewise continuous function over a finite domain exists (it is the 
area under the curves) the first integral exists. 
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The existence of the Laplace Transform therefore depends on the existence 
of the second integral We must show that this integral converges. But 

\e~ st f{t)\ < Ke~ st e at = Ke^' 3 ^ (32.14) 

Thus the second integral is bounded by 



e- st f(t)dt< / \e- st f(t)\dt 

M J M 



< / Ke {a ~ s)t dt 
= lim [ Ke {a ~ s)t dt 

T 



T->oo 



l im J^ e (-s)t 
T->oo a — s 



M 



= l im _L[ e («- S )T_ e MM, 
T->oo a — s 

0 if a < s 
oo if a > s 

Thus when s > a, the second integral in (32.13) vanishes and the total 
integral converges (is defined). □ 

Theorem 32.7 (Linearity). The Laplace Transform is lineary, e.g., for any 
two functions f(t) and g(t) with Laplace Transforms F(s) and G(s), and 
any two constants A and B, 

C[Af(t) + Ag{t)] = AC[f(t)} + BC[g(t)] = AF(s) + BG(s) (32.15) 



Proof. This property follows immediately from the linearity of the integral, 
as follows: 



C[Af(t) + Ag{t)\ = / (Af(t) + Bg(t))e- St dt (32.16) 
Jo 

/>oo />oo 

= A f(t)e~ st dt + B g{t)e~ st dt (32.17) 
Jo Jo 

= AC[f{t)] + B£[g(t)] = AF{s) + BG(s) (32.18) 



□ 
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Example 32.4. From integral A. 107, 

/>oo 

£{coskt] = / coskte~ st dt 
Jo 



e st (k sin kt — s cos kt) 



k 2 



Example 32.5. From integral A. 105, 



k 2 + s 2 
□ 



£[sin kt] 



sin kt e dt 



e st (— s sin kt — k cos kt) 



k 2 



s 2 + k 2 



□ 



Example 32.6. 



C[e at ] 



e at e~ st dt 



0 (a—s)t 



s > a □ 



Example 32.7. Using linearity and example 32. G, 

~1 



£[cosh at]dt = L 



1 



\e at + e- at ) 



C[e at ] +C[e- at ]) 



2 

= 1 ( 1 I 1 

2 \s — a s + a 

s 

= -2 2 D 

Example 32.8. Using linearity and example 32.6, 

~1 



C [sinh at] dt = C 



1/1 



1 



2 \s — a s + a 
a 

-s □ 



(32.19) 

(32.20) 
(32.21) 
(32.22) 
(32.23) 

(32.24) 
(32.25) 
(32.26) 
(32.27) 
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Example 32.9. Find the Laplace Transform of the step function 

/(«, = {»: J!'*. (32.28, 



Using the definition of £[/(<)], we compute 



£[/(*)] - / 3e- ts rf< = — e 



3e" 



□ 



(32.29) 



Laplace Transforms of Derivatives 

The Laplace Transform of a derivative is what makes it useful in our study 
of differential equations. Let f(t) be any function with Laplace Transform 
F(s). Then 



C 



\df(ty 


-j 


dt 


Jo 



df(t)„_ st 
dt 



dt 



(32.30) 



We can use integration by parts (which means we use equation A. 3) to solve 
this problem; it is already written in the form J udv with 



u = e 
dvf'{t)dt 

Since this gives v — f and du — —se~ st dt, we obtain 

/>oo 

C[f(t)] = e- St f(t)r+ S f(t)e st dt 



which we will write as 



-f(0) + sF(s) 



C[f'(t)] = sF(s)-f(0) 



(32.31) 
(32.32) 



(32.33) 
(32.34) 

(32.35) 



Thus the Laplace Transform of a Derivative is an algebraic func- 
tion of the Laplace Transform. That means that Differential equations 
can be converted into algebraic equations in their Laplace representation, 
as we will see shortly. 

Since the second derivative is the derivative of the first derivative, we can 
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apply this result iteratively. For example, 

d 



£[/"(<)] = C 



dt 



/'(*) 



-f'(0) + sC[f(t)] 

-/'(0) + S (-/(0)+sF( S )) 

-f'(0)-sf(0)+s 2 F( S ) 



(32.36) 

(32.37) 
(32.38) 
(32.39) 



Theorem 32.8. Let /,/',..., ^ be continuous on [0, oo), of expo- 
nential order, and suppose that f^(t) is piecewise continuous on [0, oo). 
Then 



C 



/(»)(*) = S «F( S ) 



/(0) 



„n — 2 j-/ 



f(0) 



/("-^(0) (32.40) 



where F(s) = C[f(t)} 



Proof. This can be proven by mathematical induction. We have already 
proven the cases for n = 1 and n — 2. As an inductive hypothesis we will 
assume (32.40) is true for general n > 1. We must prove that 



C 



(n+l) 



(*) 



„n+l 



F(s) - s n f(0) 



„n-l ft 



f(0) 



/(")(0) (32.41) 



follows directly from (32.40). 

Let g(t) = /<"). Then g'(t) = f {n+1) {t) by definition of derivative notation. 



Hence 



C 



f {n+1 Ht)} =C[g'{t)\ 

= sG(s)-g(0) 



sC 



c{n+l) 



(0) 



(32.42) 
(32.43) 
(32.44) 



Substitution of (32.40) yields (32.41) as required. 



□ 
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The Gamma Function 

Definition 32.9. The Gamma Function is defined by 



T(x) = I u'-Vdu 
o 



for x € K but x not equal to a negative integer. 



Figure 32.2: The Gamma function T(t). 




(32.45) 



If we make a change of variable u = st for some constant s and new variable 
t in (32.57), then du = sdt and 



Thus 



POO /' oc 

r(ar) = / {sty^e- 31 sdt = s x t*-^- 8 * dt 



T(x + 1) = s x+1 / t x e~ st dt = C[t x ] 
Jo 



C[t 



xi _ r(x + i) 



(32.46) 

(32.47) 
(32.48) 



The gamma function has an interesting factorial like property. Decreasing 
the argument in (32.49) by 1, 



But since 



r(x) = £[t*- 1 ] 



cc at 



(32.49) 
(32.50) 
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C[t x ^} = C 



1 d .x 




d +X 


-—t 


= l -c 


— £ 


x at 


X 


dt 



Let f(t) = t x . Then 
C 



d JJC 

—t x 
dt 



£{f(t)} = sF(s) - /(O) = sF(s) 



(32.51) 



(32.52) 



since /(O) = 0, where F(s) is given by the right hand side of (32.57) 
Substituting (32.52) into (32.51) gives 



ch*- 1 ] = -c 

x 

But from (32.51) directly 



dt 



T(x+1) 



X s 



x+1 



c[t x - 1 } 



T{x) 



Equating the last two expressions gives 

T{x) sT{x + l) 



„x + l 



(32.53) 



(32.54) 



(32.55) 



which after cancellation gives us the fundamental property of the Gamma 
function: 

(32.56) 



T(x + 1) = xT(x) 



Now observe from (32.57) that 

r(i) = / 

Jq 

From (32.56) 



1-1 — u 



du = 



~ u du = 1 



(32.57) 



r(2) 


= 1 • 


r(i) 


= 1 • 1 = 


1 = 


1! 


(32.58) 


r(3) 


= 2 • 


r(2) 


= 2 • 1 = 


2 = 


2! 


(32.59) 


r(4) 


= 3 • 


r(3) 


= 3-2 = 


6 = 


3! 


(32.60) 


r(5) 


= 4- 


r(4) 


= 4-6 = 


24 = 


= 4! 


(32.61) 


r(6) 


= 5 • 


r(5) 


= 5 • 4! = 


= 5! 




(32.62) 














(32.63) 


T(n) 


= (n 


-1)! 


for n G 


Z+ 




(32.64) 



hence for n an integer 



C[t r ' 



oM + l 



(32.65) 
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Using Laplace Transforms to Solve Linear Differential 
Equations 

The idea is this: the Laplace Transform turns derivatives into algebraic 
functions. So if we convert an entire linear ODE into its Laplace Transform, 
since the transform is linear, all of the derivatives will go away. Then we 
can solve for F(s) as a function of s. A solution to the differential equation 
is given by any function f(t) whose Laplace transform is given by F(s). 
The process is illustrated with an example. 

Example 32.10. Solve y' + 2y = 3, y(0) — 1, using Laplace transforms. 

Let Y(s) — C[y(t)] and apply the Laplace Transform operator to the entire 
equation. 

y'(t) + 2y(t) = 3t (32.66) 
C[y'(t) + 2y(t)]=£[3t] (32.67) 
C[y'(t)]+2C[y(t)]=3C[t] (32.68) 

From example 32.1, and equation 32.35, 

sY(s) - y(0) + 2Y(s) = % (32.69) 
(s + 2)Y(s)= ^+y(0) = A + 1 = i+i! (32.70) 



(32.71) 



Solving for Y(s), 



3 + ^ 
(s + 2)s 2 

The question then becomes the following: What function has a Laplace 
Transform that is equal to (3 + s 2 )/(s 2 (s + 2))? This is called the inverse 
Laplace Transform of Y(s) and gives y(t): 

' 3 + s 2 



y(t) = c- 



{s + 2)s 



(32.73) 



We typically approach this by trying to simplify the function into smaller 
parts until we recognize each part as a Laplace transform. For example, we 
can use the method of Partial Fractions to separated the expression: 

3 + = A + Bs C + Da 
(s + 2>2 ~ S 2 + s + 2 {6 ' } 

_ (A + Bs)(s + 2) (C + Ds) S 2 
~ s*(s + 2) + s 2 (s + 2) {6Z -' b) 
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Equating numerators and expanding the right hand side, 

3 + s 2 = (A + Bs)(s + 2) + (C + Ds)s 2 

= As + 2A + Bs 2 + IBs + Cs 2 + Ds 3 
= 2A + (A + 2B)s + (B + C)s 2 + Ds 3 

Equating coefficients of like powers of s, 

3 = 2A => A = 



Hence 



0 = A + 2B 

1 = B + C 
0 = D 



B = 



-A 



C = 1 - B = - 



(s + 2)i 



3 _ 3„ 
2 4^ 

s 2 
3 1 
2 ' ^ ~ 



s + 2 

3 1 7 

- • - + - • - 

4 s 4 s 



(32.76) 
(32.77) 
(32.78) 



(32.79) 

(32.80) 

(32.81) 
(32.82) 

(32.83) 
(32.84) 



From equations (32.4) and (32.8) 
we see that 



(s + 2) 



y(t) =£- x 



3 

4 + 


7 

4 ' 


e" 2t 


s 2 " 




3 

-t- 
2 


)s 2 





3 7 

4 + 4 



-2/ 



which gives us the solution to the initial value problem. □ 



(32.85) 
(32.86) 
(32.87) 



Here is a summary of the procedure to solve the initial value problem for 
V'{t): 



1. Apply the Laplace transform operator to both sides of the differential 
equation. 
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2. Evaluate all of the Laplace transforms, including any initial condi- 
tions, so that the resulting equation has all y(t) removed and replaced 
with Y(s). 

3. Solve the resulting algebraic equation for Y(s). 

4. Find a function y(t) whose Laplace transform is Y(s). This is the 
solution to the initial value problem. 

The reason why this works is because of the following theorem, which we 
will accept without proof. 

Theorem 32.10 (Lerch's Theorem 1 ). For any function F(s), there is at 
most one continuous function function /(<) defined for t > 0 for which 
£[/(*)] =F(s). 

This means that there is no ambiguity in finding the inverse Laplace trans- 
form. 

The method also works for higher order equations, as in the following ex- 
ample. 

Example 32.11. Solve y" ~ 7y' + 12y = 0, y(0) = 1, y'(0) = 1 using 
Laplace transforms. 

Following the procedure outlined above: 

0 = C[y" - 7y' + I2y] (32.88) 

= C[y"] - 7C[y'} + 12C[y] (32.89) 

= s 2 Y(s) - sy{0) ~ y'(0) - 7(sY(s) - y(0)) + 12F(s) (32.90) 

= s 2 Y(s) - s - 1 - 7sY(s) + 7+ 12Y(s) (32.91) 

= (s 2 - 7s + 12)F(s) + 6 - s (32.92) 

y(s) = S 2 - 7s + 12 = ( s -3)(s-4) = ^3 ~ ~A (32J3) 
where the last step is obtained by the method of partial fractions. Hence 
3 2 



y(t) = c- 1 



s - 3 s - 4 



3e 6t -2e 4t . □ (32.94) 



1 Named for Mathias Lcrch (1860-1922), an eminent Czech Mathematician who pub- 
lished more than 250 papers. 
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Derivatives of the Laplace Transform 

Now let us see what happens when we differentiate the Laplace Transform. 
Let F(s) be the transform of f(t). 



d 
ds 



F ^ ds J Q 



e- st f{t)dt (32.95) 

^-e- st f(t)dt (32.96) 
o " s 



e- st tf(t)dt (32.97) 
= -£[*/(*)] (32.98) 



n 



By a similar argument, we get additional factors of —t for each order of 
derivative, so in general we have 

F {n \s) = = (-l) n £[t"/(t)] (32.99) 

Thus we have the results 

C[tf(t)} = F'(s) (32.100) 
£{t n f(t)} = (-l) n F(n)( S ) (32.101) 
Example 32.12. Find F(s) for f(t) = t cos kt. 
From (32.19) we have C[coskt] = s/(s 2 + k 2 ). Hence 

£[tcoskt] = — £[cosfct] (32.102) 

(32.103) 

(32.104) 



ds s 2 + k 2 

(s 2 + fc 2 )(l) -s(2s) 



(s 2 + k 2 ) 2 

Step Functions and Translations in the Time 
Variable 

Step functions are special cases of piecewise continuous functions, where the 
function "steps" between two different constant values like the treads on 
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a stairway. It is possible to define more complicated piecewise continuous 
functions in terms of step functions. 

Definition 32.11. The Unit Step Function with step at origin, U(t) 
is defined by 

U(t) = { £ \ < l (32.106) 
The Unit Step Function with Step at to, U(t — to) is then given by 

U(t-t 0 ) = {l \H (32 - 107) 

The second function is obtained from the first by recalling that subtraction 
of to from the argument of a function translates it to the right by to units 
along the x-axis. 



Figure 32.3: A Unit Step Function U(t — t 0 ) with step at t = t 0 - 
1 • 



-o 

to 



Unit step functions make it convenient for us to define stepwise continu- 
ous functions as simple formulas with the need to list separate cases. For 
example, the function 



/CO = { 1, 0 < t < 2 (32.108) 




can also be written as (figure 32.3) 

f{t)=U{t-l)-U(t- 2) (32.109) 

while the function 

'0 t<-l 
t) = {e e -1 <t< 1 (82.110) 
t > 1 
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can be written as 

f(t) = e - e (U{t + 1) - U(t - 1) 
as illustrated in figure 32.4. 



(32.111) 



Figure 32.4: A piecewise continuous function defined with step functions. 




We can also use the combination to produce piecewise continuous transla- 
tions, for example, 



/(*) 



0. 



-(x-3) 2 ; x > 2 

x < 2 



= W(f-2)/(t-3) 



(32.112) 



The second factor (/(i — 3)) translates the bell curve to the right by 3 units, 
while the first factor cuts off the part to the left of t = 2 (figure 32.5). 



Figure 32.5: A piecewise continuous function defined by a translation mul- 
tiplied by a step functions. 



1. 

0.75 
0.5 
0.25 



1 
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The Laplace Transform of the step function is easily calculated, 

poo 

C[U(t-a)}= U(t-a)e~ st dt (32.113) 
Jo 

pOO 

= / e- st dt (32.114) 

J a 

-as 

= (32.115) 

s 

We will also find the Laplace Transforms of shifted functions to be useful: 

poo 

C[f{t)U{t -a)]= / f{t)U{t - a)e- st dt (32.116) 
Jo 

POO 

= / f(t)e~ st dt (32.117) 

Here we make a change of variable 

x = t-a (32.118) 

so that 

C[f(t)U{t-a)}= f f(x + a)e- s(x+a Ux (32.119) 
Jo 

pOO 

= e~ sa / f(x + a)e- sx dx (32.120) 
Jo 

= e- sa C[f(t + a)} (32.121) 
A similar result is obtained for 

£[f(t-a)U(t-a)}= [ f(t- a)U(t- a)e- st dt (32.122) 
Jo 

POO 

= / f{t- a)e- st dt (32.123) 

J a 



Now define 

x = t-a (32.124) 

so that 

POO 

C[f(t - a)U(t -a)}= / f(t)e- s(x+a ^dx (32.125) 
Jo 

POO 

= e~ sa / f(t)e- sx dx (32.126) 
Jo 

= e- as F(s) (32.127) 
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Translations in the Laplace Variable 

If F(s) is the Laplace Transform of f(t), 

/•OO 

F{s) = / f(t)e- st dt (32.128) 
Jo 

What happens when we shift the s-variable a distance a? Substituting 

S = s — a, 

POO 

F(s - a) = F(S) = / f(t)e- st dt (32.129) 
Jo 

/>OG 

= / f(t)e-( s - a ^dt (32.130) 
Jo 

/•OO 

= / e at f(t)e- st dt (32.131) 
Jo 

= £[e a */(t)] (32.132) 
which is often more useful in its inverse form, 

ZT 1 [^(s - a)] = e at f(t) (32.133) 
s + 2 

Example 32.13. Find /(i) such that F(s) = — ^ . 

(s — 2) 

Using partial fractions, 

5 + 2 ^ + 7 — ~~Wv2 (32.134) 



(s-2) 2 s-2 (s-2) 2 
A(s - 2) B 



Hence 



Therefore 



- (,-2)» ' (s-2) 2 (32 - 135) 
s + 2 = As + (5-2,4) (32.136) 



^ = 1 (32.137) 
B - 2,4 = 2 5 = 4 (32.138) 
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Inverting the transform, 



f(t)=£- 1 [F(s)}=£- 1 
1 



1 



= £~ l 



= e 2t C- x 



s-2 
1 



+ 4ZT 1 
+ Ae 2t C- 1 



s-2 (s-2) 2 
1 



(s-2)* 

1 



t 2 



= e 2t ■ 1 + 4e 2 * • t 
= (l+t)e 2t ] □ 



(32.140) 
(32.141) 

(32.142) 

(32.143) 
(32.144) 



Example 32.14. Solve y' +4y = e 4 *, y(0) = 2, using Laplace Transforms. 
Applying the transform, 



£{yi}+4£{y}=£[e- 4t ] 
sY{ S )-y(0) + 4Y{s)= ' 



s + 4 



(s + 4)Y(s) = 2 + 



1 



s + 4 



(32.145) 
(32.146) 

(32.147) 



Solving for Y(s), 



2 1 

y(s) = J+l + (a + 4) 2 
2/ (t)=£- 1 [F( S )] 



r- 1 

2e 



+ 



1 



s + 4 ' (s + 4) 2 
2 



s + 4 

4t£-l 



1 



(s + 4) 2 

" 1 



+ er At £~ x 



2e 



-4t 



1 + e 



-it 



(2 + i)e 



-4f 



□ 



(32.148) 
(32.149) 
(32.150) 

(32.151) 

(32.152) 

(32.153) 
(32.154) 
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Summary of Translation Formulas 



C[U{t-a)] = — 

£lf(t)U(t-a)}=e- sa £{f(t + a)} 
C[f(t - a)U{t - a)] = e- as F(s) 
C[e at f{t)]=F{ S -a) 
C- 1 [F( S -a)]=e at f(t) 



(32.155) 

(32.156) 
(32.157) 
(32.158) 
(32.159) 



Convolution 

Definition 32.12 (Convolution). Let f(t) and g{t) be integrable functions 
on (0, oo). Then the convolution of f and g is defined by 



(/*<?)(*) 



f(u)g(t - u)dt 



Som Useful Properties of the Convolution 

1- f * 9 = 9 * f (commutative) 

2- f*(g + h) = f*g + f*h (distributive) 

3. / * (g * h) = (f * g) * h (associative) 

4. /*0 = 0*/ = 0 (convolution with zero is zero) 
Example 32.15. Find sin£ * cost 

sint*cost= f sinxcos(i — x)dx 

cos t cos x + sin t sin x) dx 



I sm.x{ 
Jo 



= cost 



/ sin x cos xdx + sin t / si 
Jo Jo 



1 



= cos t - sin x 



+ sini 



o 



x sin 2x 



sin xdx 
t 



o 



1 2 ft sin2t 
= - cos t sin t + sin t [ 

2 V 2 4 



(32.160) 



(32.161) 
(32.162) 
(32.163) 
(32.164) 
(32.165) 
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Using trig substitution, 

sint * cost = ^ cost sin 2 t + ^ sint (t — sin t cost) (32.166) 

= it sint □ (32.167) 

Theorem 32.13 (Convolution Theorem). Let /(t) and g(t) be piecewise 
continuous functions on [0, oo) of expnonential order with Laplace Trans- 
forms F(s) and G(s). Then 

£[f * 9] = F(s)G(s) (32.168) 

The Laplace transform of the convolution is the product of the transforms. 
In its inverse form, the inverse transform of the product is the convolution: 

C- 1 [F(s)G(s)} = f*g (32.169) 

Proof. 

F(s)G(s) = f(t)e- ts d?J g(x)e- sx dx^j (32.170) 

(•CO rOQ 

= / f(t)g(x)e- ts - xs dtdx (32.171) 
Jo Jo 

= f(t) Qf g(x)e- s( - t+x Ux^j dt (32.172) 
In the inner integral let u = t + x. Then 

F{s)G(s) = f(t) g(u - t)e- su dt?J dt (32.173) 
Interchanging the order of integration: 

F(s)G{s) = e- su g(u - t)f(t)dtj du (32.174) 

POO 

= / e- su {f*g)(u)du (32.175) 
Jo 

= £[f*g] (32.176) 

as expected. □ 
Example 32.16. Find a function /(f) whose Laplace Transform is 

F(s) = (32.177) 
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The inverse transform is 



= cr x 


1 


k 


8 + 1) 


= cr x 


I - 

s 


c- 1 


= l-e 


-l-t 




= e"* 


□ 



8 + 1 



(32.178) 
(32.179) 



(32.180) 
(32.181) 



Example 32.17. Find a function f(t) whose Laplace Transform is 



F(s) 



(s 2 + 4s - 5) 2 



The inverse transform is 

/(*) = c- 1 



(s 2 + 4s- 5) 2 
s 



s 2 + 4s - 5 s 2 + 4s - 5 

s 1 
(s + 5)(s- 1) ' (s + 5)(s- 1) 



1 



_(s + 5)(s-l)J L(s + 5)(s-l) 
Using partial fractions, 

1 1111 



(s + 5)(s-l) 
s 



6 s + 5 6 s — 1 
5 1 11 



(s + 5)(s-l) 6 s + 5 6 s-1 
The inverse transforms of (32.187) and (32.188) are thus 



c- 1 



L(s + 5)(s-l) 



l- 1 



1 



s + 5 



s- 1 



— e- 5t + -e 
6 6 



(32.182) 

(32.183) 
(32.184) 
(32.185) 
(32.186) 

(32.187) 
(32.188) 

(32.189) 
(32.190) 



(s + 5)(s-l). 



s - 
1 



s-1 



(32.191) 
(32.192) 
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Substituting back into (32.186), 



1 „-5t i 1 t \ [ ^ 5t ( 1 ^ 



/(*)= |-« e +a e ) I e e +e e ) D ( 32 - 193 ) 



Periodic Functions 

Definition 32.14. A function /(i) is said to be periodic with period T 

if there exists some positive number such that 



f{t + T) = f{t) 



(32.194) 



for all values of t. 

To find the transform of a periodic function we only have to integrate over 
a single interval, as illustrated below. Let fit) be a periodic function with 
period T. Then its transform is 



F(S) = / fit)e- ts dt (32.195) 
Jo 

r-t poo 

= / fit)e- st dt+ / fit)e- ts dt (32.196) 
Jo Jt 

In the second integral make the substitution u = t — T, so that 

r-t f-OO 

FiS)= / fit)e~ st dt+ / fiu + T)e- {u+T)s du (32.197) 



fit)e~ st dt + e~ sT / fiu)e- us du since /(it + T) = f(u) 
o Jo 

(32.198) 

t 

fit)e- st dt + e- sT Fis) (32.199) 

o 

Rearranging and solving for F (s), 



F( S )il~e- sT )= / fit)e- st dt 
Jo 

which gives us the following result for periodic functions: 



(32.200) 



1 -e 



-sT 



fit)e~ st dt 



(32.201) 
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Example 32.18. Find the Laplace transform of the full-wave rectification 
of smt, 



/(*) 



sini 0 < t < 7r 
f{t-n) t>ir 



Using the formula for the transform of a periodic function, 
1 



F(s) 



1 - e'™ 



sinie dt 



1 



1 



1 - e-™ 1 + s 2 



-s sini — cost) 



using (A. 105) to find the integral. Hence 



F(s) = 



1 



1 



-[e 7rs (— ssin7r — cos7r) 



1 - e—* s 1 + s 2 1 

- e°(-ssin0 - cosO)] 
1 1 
1 - e~™ 1 + s 2 
1 + e~ ws 1 



2 [e— (1) + (1) 



1 - e~™ 1 + s 2 



□ 



Example 32.19. Solve y" + 9y = cos3t,y(0) = 2,y'(0) = 5. 
The Laplace Transform is 

s 2 Y(s) - sy(0) - y'(0) + 9Y(s) = 



Substituting the initial conditions and grouping, 



(9 + s 2 )F(s)-2s-5 = 



rearranging terms and solving for Y(s) 
(9 + s 2 )F(s) = 2s + 5+ 



Y(s) 



= 2 



2s + 5 s 
9 + s 2 + {9 + s 2 ) 2 
s 1 



9 + s 2 



9 + s 2 ' (9 + s 2 ) 2 



(32.202) 

(32.203) 
(32.204) 



(32.205) 
(32.206) 

(32.207) 



(32.208) 

(32.209) 

(32.210) 
(32.211) 
(32.212) 
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The inverse transform is 
2 



9 + S 2 



5 -/I" 1 



1 



- cos 3t + - sin 3t + C 1 



9 + s 2 
s 



9 + s 2 



-c- 1 



(9 + s 2 ) 2 
1 



9 + s 2 



2 5 1 

= - cos 3t + - sin 3t + - cos 3i * sin St 
o o y 



The convolution is 



cos3i*sin3t = / cos 3a; sin 3 (t — x) da 
Jo 



hence 



—t sm(3t) 



2 5 1 

y(t) = - cos 3t + — sin 3£ + — i sin 3i □ 

3 3 18 



(32.213) 
(32.214) 
(32.215) 

(32.216) 
(32.217) 

(32.218) 



Impulses 



Impulses are short, sudden perturbations of a system: quickly tapping on 
the accelerator of your car, flicking a light switch on and off, injection of 
medicine into the bloodstream, etc. It is convenient to describe these by 
box functions - with a step on followed by a step off. We define the Unit 
Impulse of Width a at the Origin by the function 



0 t < -a 
S a (t) = \ 2a -a <t < a 
0 t > a 



In terms of the unit step function, 

1 



<*«(*) = ^{U{t + a)-U{t-a)) 
la 



(32.219) 



(32.220) 



As the value of a is decreased the width of the box gets narrower but 
the height increases, making it much more of a sudden spike, but in each 
case, the area of the box is unity. In the limit, a sequence of narrower 
and narrower boxes approaches an infinitely tall spike which we call the 
Dirac-delta function 2 

S(t) = IhnSJt) (32.221) 

a— ^0 



3 For Paul Dirac (1902-1982), one of the founders of quantum mechanics. 
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Similarly, we can express a unit impulse centered at to by a right shift, as 
S a (t — to), and an infinite unite spike as S(t — to). 



Figure 32.6: Unit impulse of width a at the origin (left). Sequence of 
sharper and sharper impulses on the right, with smaller and smaller a 
values. 

1 2a 5 



-0 



X 



1 0 1 



The Laplace transform of the unit impulse is 

1 



£[6 a {t - t 0 )] = £ 



2a 



(U{t + a-t 0 )-U(t-a- t 0 )) 



1 

2a 

e (a-t 0 )s e -(a+t 0 )s 



[C[U(t + a - t 0 )} - C[U(t - a - to)]] 



2as 

-t 0 s' 



2as 



-toe 



2as 
sinh as 

as 



(32.222) 
(32.223) 
(32.224) 
(32.225) 
(32.226) 



To get the Laplace transform of the delta function we take the limit as 
a 0, 

, sinh as 



C[S(t-ta)] = lim e" toS 

a->o as 



(32.227) 

Since the right hand side — > 0/0 we can use L'Hopital's rule from calculus, 

a cosh as 



C[S(t-t 0 )] = er toS lim 

a— >0 a 



= e toS lim cosh as 

a->0 

= e - tos 



(32.228) 
(32.229) 
(32.230) 
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Since when to = 0, e~ toS = e° = 1, 

C[S(t)] = 1 

Example 32.20. Solve the initial value problem 

y"+y = 8(y-ir), y(0) = y'(0) = 0 

The Laplace transform gives us 

s 2 Y(s)-sy(0)-y'(0) + Y(S)=e-™ 
(s 2 + l)Y(s) = e~™ 

Y(s) 



1 + s 2 

But recall that (see (32.156)) 

£[/(£ - a)U{t - a)] = e - as F(s) 

=> f{t-a)U{t-a) = £- 1 [e- QS F(s)] 
=^ /(<-7r)W(i-^)=£- 1 [e- a ^( S )] 
If we let F(s) = 1/(1 + s 2 ) then f(t) = suit. Hence 

U{t-%) sini = £ _1 



1 + s 2 



and therefore 



y(t) = U{t - 7r)sini 



(32.231) 

(32.232) 

(32.233) 
(32.234) 

(32.235) 

(32.236) 

(32.237) 
(32.238) 

(32.239) 
(32.240) 
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Figure 32.7: Solution of example in equation 32.232. The spring is initially 
quiescent because there is neither any initial displacement nor velocity, 
but at t = 7r there is a unit impulse applied causing the spring to begin 
oscillations. 
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Lesson 33 



Numerical Methods 



Euler's Method 



By a dynamical system we will mean a system of differential equations 

of the form 

Vi = h{t,Vx,V2, ■■■,y n ) 1 
2/2 = f2(t,yi,y2, ■■■,y n ) 



(33.1) 



Vn = fn{t,yi,V2, ■■■,Vn), 

and accompanying initial conditions 

yi(t 0 ) = j/io,j/2(*o) = 2/2,0, ■ • .,j/ n (*o) = 2Mo 



(33.2) 



In the simplest case we have a single differential equation and initial con- 
dition (n=l) 

y' = f(t,y), 2,(0) = 2/0 (33.3) 

While it is possible to define dynamical systems that cannot be expressed in 
this form, e.g., they have partial derivatives or depend on function values 
at earlier time points, we will confine our study to these equations. In 
particular we will look as some of the techniques to solve the single equation 
33.3. The generalization to higher dimensions (more equations) comes from 
replacing all of the variables in our methods with vectors. 

Programming languages, in general, do not contain methods to solve dif- 
ferential equations, although there are large, freely available libraries that 
can be used for this purpose. Analysis environments like Mathematica and 
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Matlab have an extensive number of functions built in for this purpose, so 
in general, you will never actually need to implement the methods we will 
discuss in the next several sections if you confine yourself to those envi- 
ronments. Sometimes, however, the built-in routines don't provide enough 
generality and you will have to go in and modify them. In this case it helps 
to understand the basics of the numerical solution of differential equations. 

By a numerical solution of the initial value problem 

y' = f(t,y), y(io) = y 0 (33.4) 

we mean a sequence of values 

yo,yi,V2,.~,yn-i,y n ; (33.5) 

a corresponding mesh or grid Ai by 

m = {t 0 < h < h < ■ ■ ■ < t»_i < U; (33.6) 

and a grid spacing as 

hj = tj + i — tj (33.7) 

Then the numerical solution or numerical approximation to the solution is 
the sequence of points 

(to,yo), (h,yi), ■ ■ ■ , (t n -i,s/„-i), (t n ,y n ) (33.8) 

In this solution the point (tj,yj) represents the numerical approximation 
to the solution point yitj). We can imagine plotting the points (33.8) and 
then "connecting the dots" to represent an approximate image of the graph 
of y(t),t 0 <t<t n . We will use the convenient notation 

Vn « y(tn) (33.9) 

which is read as "y„ is the numerical approximation to y(t) at t = t n ." 

Euler's Method or the Forward Euler's Method is constructed as 
illustrated in figure 33.1. At grid point t n , y(t) ~ y n , and the slope of the 
solution is given by exactly y' = f(t n ,y(t n )). If we approximate the slope 
by the straight line segment between the numerical solution at t n and the 
numerical solution at t„+i then 

yjtn) ~ -, —r- = t (33.10) 
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Figure 33.1: Illustration of Euler's Method. A tangent line with slope 
f{tot Uo) is constructed from {to, yo) forward a distance h = t\ — to in the t— 
direction to determined y^. Then a line with slope f{t\,yi) is constructed 
forward from (ti,$/i) to determine 1/2, and so forth. Only the first line is 
tangent to the actual solution; the subsequent lines are only approximately 
tangent. 




Since y'{t) = f{t,y), we can approximate the left hand side of (33.10) by 

!/„(*»)*/(*», V») (33.11) 

and hence 



Vn+l = Vn + h n f(t„, J/ n ) (33.12) 



It is often the case that we use a fixed step size h = tj+i — tj, in which case 
we have 

tj^to+jh (33.13) 
In this case the Forward Euler's method becomes 

Vn+i = Vn + hf(t n ,y n ) (33.14) 

The Forward Euler's method is sometimes just called Euler's Method. 

An alternate derivation of equation (33.12) is to expand the solution y(t) 
in a Taylor Series about the point t = t n : 

h 2 

y(t n+1 ) = y{t n + h n ) = y(t n ) + h n y'{t n ) + -fy"(t n ) + ■■■ (33.15) 
= y(t n ) + h n f(t n , »(„)) + •■• (33.16) 
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We then observe that since y n ~ y(t n ) and y n +\ ~ y(t n+ i), then (33.12) 
follows immediately from (33.16). 

If the scalar initial value problem of equation (33.4) is replaced by a systems 
of equations 

y' = f(t,y), y(t 0 ) = yo (33.17) 
then the Forward Euler's Method has the obvious generalization 

y«+i = yn + hf(t n ,y n ) (33.18) 

Example 33.1. Solve y' = y, y(0) = 1 on the interval [0, 1] using h = 0.25. 

The exact solution is y = e x . We compute the values using Euler's method. 
For any given time point tk, the value yk depends purely on the values of 
tk 1 and j/fcj . This is often a source of confusion for students: although the 
formula yu+i = Vk + hf(tk, yt) only depends on and not on tf-^x it gives 
the value of yu+i- 

We are given the following information: 

(to.ifo) = (0,1) 

f(t,y)=y } C«.:H)! 
h = 0.25 

We first compute the solution at t = t\. 

Vi=yo + hf(t 0 , yo)=l + (0.25)(1) = 1.25 (33.20) 
h = t 0 +h = 0 + 0.25 = 0.25 (33.21) 
(ti,lft) = (0.25,1.25) (33.22) 

Then we compute the solutions at t = t\,t%, . . . until ifc+i = 1. 

V2=yi + hf{t uVl ) (33.23) 

= 1.25 + (0.25) (1.25) = 1.5625 (33.24) 

t 2 = h +h = 0.25 + 0.25 = 0.5 (33.25) 

(ta,ifc) = (0.5,1.5625) (33.26) 

y3 = y2 + hf(t 2 ,y 2 ) (33.27) 

= 1.5625 + (0.25) (1.5625) = 1.953125 (33.28) 

h =t 2 + h = 0.5 + 0.25 = 0.75 (33.29) 

(*3, ys) = (0.75, 1.953125) (33.30) 
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y4 = y3 + h,f(t 3 ,y 3 ) (33.31) 

= 1.953125 + (0.25) (1.953125) = 2.44140625 (33.32) 

t 4 = t 3 + 0.25 = 1.0 (33.33) 

(U, y A ) = (1.0, 2.44140625) (33.34) 

Since t± — 1 we are done. The solutions are tabulated in table ?? for this 
and other step sizes. □ 



t 


h = 1/2 


ft = 1/4 


h = 1/8 


h = 1/16 


exact solution 


0.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.0625 








1.0625 


1.0645 


0.1250 






1.1250 


1.1289 


1.1331 


0.1875 








1.1995 


1.2062 


0.2500 




1.2500 


1.2656 


1.2744 


1.2840 


0.3125 








1.3541 


1.3668 


0.3750 






1.4238 


1.4387 


1.4550 


0.4375 








1.5286 


1.5488 


0.5000 


1.5000 


1.5625 


1.6018 


1.6242 


1.6487 


0.5625 








1.7257 


1.7551 


0.6250 






1.8020 


1.8335 


1.8682 


0.6875 








1.9481 


1.9887 


0.7500 




1.9531 


2.0273 


2.0699 


2.1170 


0.8125 








2.1993 


2.2535 


0.8750 






2.2807 


2.3367 


2.3989 


0.9375 








2.4828 


2.5536 


1.0000 


2.2500 


2.4414 


2.5658 


2.6379 


2.7183 
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The Backwards Euler Method 

Now consider the IVP 

y' = -5ty 2 +*-^, 7/(1) = 1 (33.35) 

The exact solution is y = 1/t. The numerical solution is plotted for three 
different step sizes on the interval [1,25] in the following figure. Clearly 
something appears to be happening here around h — 0.2, but what is it? 
For smaller step sizes, a relatively smooth solution is obtained, and for 
larger values of h the solution becomes progressively more jagged (figure 
??). 




This example illustrates a problem that occurs in the solution of differential 
equations, known as stiffness. Stiffness occurs when the numerical method 
becomes unstable. One solution is to modify Euler's method as illustrated 
in figure 33.3 to give the Backward's Euler Method: 



Vn = Un-i + h n f(t n ,y n ) 



(33.36) 



The problem with the Backward's Euler method is that we need to know the 
answer to compute the solution: y n exists on both sides of the equation, and 
in general, we can not solve explicitly for it. The Backwards Euler Method 
is an example of an implicit method, because it contains y n implicitly. 
In general it is not possible to solve for y n explicitly as a function of y n -i 
in equation 33.36, even though it is sometimes possible to do so for specific 
differential equations. Thus at each mesh point one needs to make some 
first guess to the value of y n and then perform some additional refinement 
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Figure 33.3: Illustration of the Backward's Euler Method. Instead of con- 
structing a tangent line with slope /(to. Do) through (to, yo) a line with slope 
}(t\,yi) is constructed. This necessitates knowing the solution at the t\ in 
order to determine y\(t\) 

yi 
>'i 



to t\ tj 



to improve the calculation of y n before moving on to the next mesh point. 
A common method is to use fixed point iteration on the equation 

y = k + hf(t,y) (33.37) 

where k = y n —\. The technique is summarized here: 

• Make a first guess at y n and use that in right hand side of 33.36. A 
common first guess that works reasonably well is 

V ( n ] = Vn-l (33.38) 

• Use the better estimate of y n produced by 33.36 and then evaluate 
33.36 again to get a third guess, e.g., 

V ( n +1) =Vn-i + hf(t n ,yM) (33.39) 

• Repeat the process until the difference between two successive guesses 
is smaller than the desired tolerance. 

It turns out that Fixed Point iteration will only converge if there is some 
number K < 1 such that \dg/dy\ < K where g(t, y) = k + hf(t, y). A more 
stable method technique is Newton's method. 




366 



LESSON 33. NUMERICAL METHODS 



Figure 33.4: Result of the forward Euler method to solve y' = — 100(2/ — 
sin i), 2/(0) = 1 with h = 0.001 (top), h = 0.019 (middle), and h = 0.02 
(third). The bottom figure shows the same equation solved with the back- 
ward Euler method for step sizes of h = 0.001,0.02,0.1,0.3, left to right 
curves, respectively 




0 0.5 1 1.5 2 2.5 3 




0 0.5 1 1.5 2 2.5 3 




0 0.5 1 1.5 2 2.5 3 




0 0.5 1 1.5 2 2.5 3 



Improving Euler's Method 

All numerical methods for initial value problems of the form 

y'(t) = f(t,y), y(to) = Vo (33.40) 

variations of the form 

Un+i =y n + </>(tn,y n ,---) (33.41) 

for some function <f>. In Euler's method, <f> — hf(t n ,y n ); in the Backward's 
Euler method, (p = hf(t n +i,y n +i). In general we can get a more accurate 
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result with a smaller step size. However, in order to reduce computation 
time, it is desirable to find methods that will give better results withou 
a significant decrease in step size. We can do this by making <j> depend 
on values of the solution at multiple time points. For example, a Linear 
Multistep Method has the form 

y n +i + a 0 y n + aiVn-i H = h(b 0 f n+1 + hf n + b 2 f n -i H ) (33.42) 

For some numbers ao,a\,... and 60,61,.... Euler's method has ao = 
— 1, ai = 02 = ■ ■ ■ = 0 and 61 = 1, 60 = 62 = 63 = • • • = 0 

Here we introduce the Local Truncation Error, one measure of the 
"goodness" of a numerical method. The Local truncation error tells us 
the error in the calculation of y, in units of h, at each step t n assuming 
that there we know y n ~i precisely correctly. Suppose we have a numerical 
estimate y n of the correct solution at y(t n ). Then the Local Truncation 
Error is defined as 



Assuming we know the answer precisely correctly at t n -\ then we have 



LTE= \{y{t n )-y n ) 



(33.43) 



= -r(y(tn) - y{t n -i) + y{t n -i) - y n ) 



(33.44) 



2/n-l 



= y{t n -i) 



(33.45) 



so that 



LTE = 



y(t n ) - y(t n -i) y n -i- y n 
h h 



(33.46) 




(33.47) 



For Euler's method 



<t> = hf(t,y) 



(33.48) 



hence 



LTE(Euler) = 



y(t n ) - y(t n -i) 

h 



- f(t n ,y n ) 



(33.49) 
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If we expand y in a Taylor series about 

h 2 

y{t n ) = y(t n -i) + + yy"(*n-i) + • • • (33.50) 

/l 2 

= y(t„_i) + ft/(t n _i,y„_i) + yy"(t„-i) + • • • (33.51) 

Thus 

LTE(Eulcr) = ^y"(t„_i) + c 2 fr 2 + c 3 /i 3 + • • • (33.52) 

for some constants ci,c 2 , ... Because the lowest order term in powers of h 
is proportional to h, we say that 

LTE(Eulcr) = 0(h) (33.53) 

and say that Euler's method is a First Order Method. In general, to 
improve accuracy for a given step size, we look for higher order methods, 
which are 0(h n ); the larger the value of n, the better the method in general. 

The Trapezoidal Method averages the values of / at the two end points. 
It has an iteration formula given by 

Vn = Vn-l + ^ {f(tn,Vn) + / (*n-l,J/n-l)) (33.54) 

We can find the LTE as follows by expanding the Taylor Series, 

LTE(Trapezoidal) = V ^ Z^zl) - f(t n ,y n ) (33.55) 
1 / h 2 h 3 

= ^ ( y(*n-l) + V(*n-l) + yy"(*n-l) + gjV'ftn-l) + y(*n-l) 

- ^ (/(*„, Vn) + /(*„-!, Vn-l)) (33.56) 

Therefore using i) = /(t„_i, 

LTE(Trapczoidal) - ^/(i„_i,i/ n _i) + ^tf"(t„-i) + y2/'"(in-i) \f{t n , 

(33.57) 
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Expanding the final term in a Taylor series, 

f{t n ,y n ) = y'{tn) (33.58) 

= l/(tn-l) + + yfHtn-i) + ■ ■ ■ (33-59) 

h 2 

= /(t„_i,y„_i) + V(*n-i) + y/'(*n-i) + • • • (33.60) 
Therefore the Trapezoidal method is a second order method: 

LTE(Trapczoidal = l -f n _ x + + *^tf_ x + ■■■ 

\f n -i \hy'U \h 2 y'Z-i + ■ ■ ■ (33.61) 

= -^ 2 y"'-i + --- (33.62) 
= 0(/i 2 ) (33.63) 

The theta method is given by 

y n = y n -i + h [0/(i„_i, t/„_i) + (1 - 6)f(t n ,y n )} (33.64) 

The theta method is implicit except when 9 = 1, where it reduces to Euler's 
method, and is first order unless 9 = 1/2. For 9 = 1/2 it becomes the trape- 
zoidal method. The usefulness of the comes from the ability to remove the 
error for specific high order terms. For example, when 9 = 2/3, there is no 
h 3 term even though there is still an h 2 term. This can help if the coefficient 
of the h 3 is so larger that it overwhelms the the h 2 term for some values of h. 



The second-order midpoint method is given by 

Vn = Vn-1 + Kf (t n -l/2, ^[y n + Vn-l]j (33.65) 



The modified Euler Method, which is also second order, is 

y n = Vn-l + y [/(t n -l,2/n-l) + /(*n,2/n-l + hf{t n -\, J/„-l))] (33.66) 
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Heun's Method is 

hn 



y n = y n -i+- 



2 2 

f(t n -i,y n -i) + 3/ ( i„-i + -h,y n -t + -ft/(t„_i, y n -i) 



(33.67) 

Both Heun's method and the modified Euler method arc second order and 
are examples of two-step Runge-Kutta methods. It is clearer to implement 
these in two "stages," eg., for the modified Euler method, 



Vn = Vn-l + /l/(in-l,2/n-l) 

Vn = Vn-l + ^-\f{t n -i,y n -i) + f(t n ,y n ) 



while for Heun's method, 
2 

Vn = Vn-l + g/l/(*n-l,2/n-l) 



Vn = 2/n-l + 



h n 



f{t n -i,y n -i) + 3/ ( t n -i + -h,y r 



(33.68) 
(33.69) 

(33.70) 
(33.71) 



Runge-Kutta Fourth Order Method. This is the "gold standard" of 
numerical methods - its a lot higher order than Euler but still really easy 
to implement. Other higher order methods tend to be very tedious - even 
to code - although once coded they can be very useful. Four intermediate 
calculations are performed at each step: 



ki = hf(t n ,y n ) 
h = hf(t n + .5/i, y n + .5fci) 
k 3 = hf(t n + .5ft, y n + .5fc 2 ) 
k 4 = hf(t n + h,y n + k 3 ) 

Then the subsequent iteration is given by 



(33.72) 
(33.73) 
(33.74) 
(33.75) 



Vn+l = Vn + g(fcl + 2fc 2 + 2k 3 + ki) 



(33.76) 



Example 33.2. Compute the solution to the test equation y' — y, y(0) = 1 
on [0, 1] using the 4-stage Runge Kutta method with h = 1/2. 



Since we start at t = 0 and need to compute through t = 1 we have to 
compute two iterations of RK. For the first iteration, 



h = yo = 1 



(33.77) 
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k 2 =yo + ^f(to,ki) (33.78) 

= 1 + (0.25)(1) (33.79) 
= 1.25 (33.80) 



k 3 = yo + ^f(ti/2,k 2 ) (33.81) 

= 1 + (0.25)(1.25) (33.82) 
= 1.3125 (33.83) 



k 4 = y 0 + hf(t 1/2 ,k 3 ) (33.84) 
= 1 + (0.5)(1.3125) (33.85) 
= 1.65625 (33.86) 



Vi = Vo + |(/(to, fci) + 2/(*i /2 , k 2 ) + 2/(t 1/2) fc 3 ) + /(ii, fc 4 )) (33.87) 

= 2/o + ^ (fei + 2/c 2 + 2fc 3 + fc 4 ) (33.88) 

= 1 + ^1 + 2(1.25) + 2(1.3125) + 1.65625 (33.89) 
6 

= 1.64844 (33.90) 

Thus the numerical approximation to y(0.5) is y\ rts 1.64844. For the second 
step, 

fcj = 2/1 = 1.64844 (33.91) 



= tfi + ^/(*i,fci) (33.92) 
= 1.64844 + (0.25) (1.64844) (33.93) 
= 2.06055 (33.94) 



fc 3 =yi + ^/(*i.5,fc 2 ) (33.95) 

= 1.64844 + (0.25)(2.06055) (33.96) 
= 2.16358 (33.97) 
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k 4 = yi +hf(h. 5 ,k 3 ) (33.98) 
= 1.64844 + (0.5)(2. 16358) (33.99) 
= 2.73023 (33.100) 



V2 = yi + ^(k 1 +2k 2 + 2k 3 + k i ) (33.101) 

= 1.64844 + ^1.64844 + 2(2.06055) + 2(2.16358) + 2.73023 (33.102) 
= 2.71735 (33.103) 

This gives us a numerical approximation of y(l) w 2.71735, and error of 
approximately 0.034% (the exact value is e w 2.71828. By comparison, a 
forward Euler computation with the same step size will yield a numerical 
result of 2.25, an error approximately 17%. □ 



Since it is an explicit method, the Rungc-Kutta 4-stage method is very easy 
to implement in a computer, even though calculations are very tedious to 
do by hand 



Lesson 34 



Critical Points of 
Autonomous Linear 
Systems 



Definition 34.1. A differential equation (or system of differential equa- 
tions) is called autonomous if it does not expressly depend on the in- 
dependent variable t, e.g., the equation y' = f(t,y) can be replaced with 
y' = s(u) f° r some function g. 

Example 34.1. The function y' — smy is autonomous, while the function 
y' = tcosy is not autonomous. The system 

x' = cosy + x 2 (34.1) 
y' = smx (34.2) 

is autonomous, while the system 

x' = cosy + x 2 (34.3) 
y' = sxax + e at (34.4) 

is not autonomous. □ 



When we talk about systems, we do not loose any generality by only focus- 
ing on autonomous systems because any non-autonomous system can be 
converted to an autonomous system with one additional variable. For ex- 
ample, the system 34.3 to 34.4 can be made autonomous by defining a new 
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variable with differential equation z — t, with differential equation z' = 1, 
and adding the third equation to the system: 

x' = cosy + x 2 (34.5) 
y' = smx + e az (34.6) 
z' = 1 (34.7) 

We will focus on the general two dimensional autonomous system 



x 1 = f(x,y) x(t 0 ) = x 0 
y' = 9(x,y) y(t 0 ) = y 0 



(34. 



where / and g are differentiable functions of x and y in some open set 
containing the point (xo,?/o)- From the uniqueness theorem, we know that 
there is precisely one solution {x(t),y(t)} to (34.8). We can plot this solu- 
tion as a curve that goes through the point (xo,yo) and extends in either 
direction for some distance. We call this curve the trajectory of the solu- 
tion. The xy-p\&ne itself we will call the phase-plane. 

We must take care to distinguish trajectories from solutions: the trajec- 
tory is a curve in the xy plane, while the solution is a set of points that 
are marked by time. Different solutions follow the same trajectory, but at 
different times. The difference can be illustrated by the following analogy. 
Imagine that you drive from home to school every day on certain road, say 
Nordhoff Street. Every day you drive down Nordhoff from the 405 freeway 
to Reseda Boulevard. On Mondays and Wednesdays, you have morning 
classes and have to drive this path at 8:20 AM. On Tuesdays and Thurs- 
days you have evening classes and you drive the same path, moving in the 
same direction, but at 3:30 PM. Then Nordhoff Street is your trajectory. 
You follow two different solutions: one which puts you at the 405 at 8:20 
AM and another solution that puts at the 405 at 3:30 PM. Both solutions 
follow the same trajectory, but at different times. 

Returning to differential equations, an autonomous system with initial con- 
ditions x(to) — a. y(to) — b will have the same trajectory as an autonomous 
system with initial conditions x(ti) — a,y(ti) = 6, but it will be a differ- 
ent solution because it will be at different points along the trajectory at 
different times. 

In any set where f(x, y) ^ 0 we can form the differential equation 

dy = g(x,y) g) 
dx f(x,y) 
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Since both / and g arc diffcrentiable, their quotient is diffcrcntiablc (away 
from regions where/ = 0) and hence Lipshitz; consequently the initial value 
problem 

dy g{x,y) , . . . 

T x = W^y ^ o) = yo (34 - 10) 

has a unique solution, which corresponds to the trajectory of equation 

(34.8) through the point [xa,yo). Since the solution is unique, we con- 
clude that there is only one trajectory through any point, except possibly 
where/(x, y) — 0. A plot showing the one-parameter family of solutions to 

(34.9) , annotated with arrows to indicate the direction of motion in time, 
is called a phase portrait of the system. 

Example 34.2. Let {xi,yi} and {x2,?/2} be the solutions of 



x' = -y, x(0) = 1 (34.11) 

y' = x, y(0) = 0 (34.12) 

and 

x' = -y, o;(7r/4) = 1 (34.13) 

y' = x, y(7r/4) = 0 (34.14) 

respectively. 

The solutions are different, but both solutions follow the same trajectory. 

To see this we solve the system by forming the second order differential 
equation representing this system: differentiate the second equation to ob- 
tain y" = x'\ then substitute the first equation to obtain 

y" = -y (34.15) 

The characteristic equation is r 2 +l = 0 with roots of ±i; hence the solutions 
are linear combinations of sines and cosines. As we have seen, the general 
solution to this system is therefore 

y = A cost + Bsint (34.16) 
x = -Asint + Bcost (34.17) 

where the second equation is obtained by differentiating the first (because 
x = y'). 
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The initial conditions for (34.11) give 



0 = AcosO + SsinO = A (34.18) 

1 = -AsinO + B cos 0 = B (34.19) 



hence the solution is 



y = sint (34.20) 

x = cost (34.21) 

The trajectory is the unit circle because 

x 2 + y 2 = 1 (34.22) 

for all t, and the solution is the set of all points starting at an angle of 0 
from the x axis. 

The initial conditions for (34.13), on the other hand, give 

0 = A^+B^ (34.23) 



2 2 

1 = -A^+B^ (34.24) 



adding the two equations 



l = 2B^=BV2 =* B=-L = ^ (34.25) 

hence _ 

A=-B = -^y (34.26) 



which gives a solution of 



/2 \/2 

x cost sin t (34.27) 



2 2 
— sin t + ^- cost (34.28) 
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Using the cos7r/4 = \/2/2 and angle addition formulas, 

y = — cos — cos t + sin — sin t (34.29) 
4 4 

= -cosQ + t) (34.30) 

7T 7T 

x = cos — sin t + sin — cos t (34.31) 
4 4 v y 

= sin(!+t) (34.32) 

The trajectory is also the the unit circle, because we still have x 2 + y 2 = 1, 
but not the solution starts at the point 45 degrees above the x-axis. 

The two solutions are different, but they both follow the same trajectory. 

□ 



Definition 34.2. A Critical Point of the system x' = f(x, y), y' = g(x, y) 
(or fixed point or local equilibrium) is a any point (x*,y*) such that 
both of the following conditions 

f(x*,y*)=0 (34.33) 
g(x*,y*)0 (34.34) 



hold simultaneously. 



A critical point is a unique kind of trajectory: anything that starts there, 
stays there, for all time. They are thus zero-dimensional, isolated trajec- 
tories. Furthermore, no other solution can pass through a critical point, 
because once there, it would have to stop. 1 

If there is an open neighborhood about a critical point that does not contain 
any other critical points, it is called an isolated critical point. Certain 
properties (that we will discuss presently) of linear systems at isolated criti- 
cal points determine the global geometry of the phase portrait; for nonlinear 
systems, these same properties determine the local geometry. 

We will classify a critical point P based on the dynamics of a particle 
placed in some small neighborhood N of P, and observe what happens as 
t increases. We call P a 



1. Sink, Attractor, or Stable Node if all such points move toward P; 



1 This does not prevent critical points from being limit points of solutions (a,st — > ±oo) 
and thus appearing to be part of another trajectory but this is an artifact of how we 
draw phase portraits. 
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Figure 34.1: Varieties of isolated critical points of linear systems. The 
circles represented neighborhoods; the lines trajectories; the arrows the 
direction of change with increasing value of t in a solution. 




2. Source, Repellor, or Unstable Node if all such points move away 
from P; 

3. Center, if all trajectories loop around P in closed curves; 

4. Saddle Point or Saddle Node if some solutions move toward P 
and some move away. 



Let us begin by studying the linear system 

x 1 = ax + by | 

/ (34.35) 
y = cx + ay I 

where the matrix 

A ={ a c d) ( 34 - 36 ) 

is nonsingular (i.e., its determinant is non-zero and the matrix is invertible). 
To find the critical points we set the derivatives equal to zero: 

0 = ax* + by* (34.37) 
0 = cx* + dy* (34.38) 

The only solution is (x*,y*) = (0,0). Hence (34.35) has a single isolated 
critical point at the origin. 

The solution depends on the roots of the characteristic equation, or eigen- 
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values, of the matrix. Wc find these from the determinant of A — A/, 



0 = 



a — X b 
c d — X 



= (a — X)(d— X) - be 

= A 2 - (a + d)X + ad-bc 



Writing 



T = tracc(A) = a + d 
A = dct(A) = ad -be 

the characteristic equation becomes 

0 = A 2 - TX + A 

There are two roots, 



2 

A 2 = i(T 



Ai = - (T + VT 2 - 4A 
VT 2 - 4A) 



(34.39) 

(34.40) 
(34.41) 



(34.42) 
(34.43) 



(34.44) 

(34.45) 

(34.46) 
(34.47) 



If there are two linearly independent eigenvectors v and w, then the general 
solution of the linear system is 



Ave 



Bwe 



(34.48) 



This result holds even if the eigenvalues are a complex conjugate pair, or if 
there is a degenerate eigenvalue with multiplicity 2, so long as there are a 
pair of linearly independent eigenvectors. 

If the eigenvalue is repeated but has only one eigenvector, v then 



[Av + B(tv + w)] e 



(34.49) 



where w is the generalized eigenvector. In the following paragraphs we will 
study the implications of equations (34.48) to (34.49) for various values of 
the eigenvalues, as determined by the values of the trace and determinant. 
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Distinct Real Nonzero Eigenvalues of the Same Sign 



If T 2 > 4 A > 0 both eigenvalues will be real and distinct. Repeated 
eigenvalues are excluded because T 2 ^ 4A. 

IfT > 0, both eigenvalues will both be positive, while if T < 0 both eigenval- 
ues will be negative (note that T = 0 does not fall into this category). The 
solution is given by (34.48); A and B are determined by initial conditions. 

The special case A = B = 0 occurs only whena;(io) = y(to) = 0, which 
gives the isolated critical point at the origin. For nonzero initial conditions, 
the solution will be a linear combination of the two eigensolutions 

yi = ve Alt (34.50) 
2/2 = we* 2 ' (34.51) 

By convention we will choose Ai to be the larger of the two eigenvalues 
in magnitude; then we will call the directions parallel to v and vthe fast 
eigendirection and the slow eigendirection, respectively. 

If both eigenvalues are positive, every solution becomes unbounded as t — > 
co (because e Xit — > oo as t — > oo) and approaches the origin as t — > — oo 
(because e Xit — > 0 as t — > — oo), and the origin is called a source, repellor, 
or unstable node. 

If both eigenvalues are negative, the situation is reversed: every solution 
approaches the origin in positive time, as t —> oo, because e Xit — >• 0 as 
t — > oo, and diverges in negative time as t — > — oo (because e Xit — > oo at 
t —> — oo), and the origin is called a sink, attractor, or stable node. 

The names stable node and unstable node arise from the dynamical 
systems interpretation: a particle that is displaced an arbitrarily small 
distance away from the origin will move back towards the origin if it is a 
stable node, and will move further away from the origin if it is an unstable 
node. 

Despite the fact that the trajectories approach the origin either as t — > 
oo or t — > — oo, the only trajectory that actually passes through the 
origin is the isolated (single point) trajectory at the origin. Thus the only 
trajectory that passes through the origin is the one with A = B = 0. To 
see this consider the following. For a solution to intersect the origin at a 
time t would require 

Ave Alt + Bwe A2 ' = 0 (34.52) 
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This means that we could define new constants at any fixed time t 

a(t) = Ae Xlt and b(t) = Be* 2 * (34.53) 

such that 

o(t)v + b{t)w = 0 (34.54) 

Since mathbfv and w are linearly independent, the only way this can hap- 
pen is when a(t) = 0 and b(t) — 0 at the same same time. There is no t 
value for which this can happen because 

e xt ^ 0 (34.55) 

for all possible values of A. Thus the only way for (34.54) to be true is for 
A = B = 0. This corresponds to the solution (x,y) = (0,0), which is the 
point at the origin. 




The geometry is illustrated in figure 34.3. The two straight lines passing 
through the origin correspond to A = 0, B ^ 0 and B = 0, A ^ 0 respec- 
tively, namely the two eigendirections. The solutions on the eigendirections 
are Ae Xlt and Be x t, with different initial conditions represented by differ- 
ent values of A and B. If the eigenvalues are positive, a particle that starts 
along one of these eigendirections (i.e., has initial conditions that start the 
system on an eigendirection) moves in a straight line away from the origin 
as t — > oo and towards the origin as t — > — oo. If the eigenvalues are nega- 
tive, the particle moves in a straight line away from the origin as t — > — oo 
and towards the origin asi — > oo. Trajectories that pass through other 
points have both A^O and B ^ 0 so that y = Ave Xlt + W 2 '. If both 
eigenvalues are positive, then for large positive time (as t — > oo) the fast 
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eigendirection {Ai , vi}dominates and the solutions will approach lines par- 
allel to vi, while for large negative time (t — > — oo) the solutions approach 
the origin parallel to the slow eigendirection. The situation is reversed for 
negative eigenvalues: the trajectories approach the origin along the slow 
eigendirection as t — ¥ oo and diverge parallel to the fast eigendirection as 
t —> — oo. 



Figure 34.4: Phase portrait for the system (34.56). 
3F 




Example 34.3. Classify the fixed points and sketch the phase portrait of 
the system 



x' = x + y 
y' = -2x + Ay. 



The matrix of coefficients is 



.4 



1 f 



-2 4, 

so that T = 5 and A = 6. Consequently the eigenvalues are 



A = 



\(T± VT 2 - 4A) 



= - (5 ± V25 - 24) 
= 3,2 



(34.56) 
(34.57) 

(34.58) 

(34.59) 
(34.60) 
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The eigenvalues are real, positive, and distinct, so the fixed point is a 
source. The fast eigenvector, corresponding to the larger eigenvalue, A = 3, 

is v = ■ The slow eigenvector, corresponding to the smaller eigenvalue 

A = 2, is w = ( j J . Near the origin, the slow eigendirection dominates, 

while further away, the fast eigendirection dominates. The trajectories 
mostly leave the origin tangentially to the line y = x, which is along the 
slow eigendirection, then bend around parallel the fast eigendirection as 
one moves away from the origin. The phase portrait is illustrated in figure 
34.4. □ 



Repeated Real Nonzero Eigenvalues 

If T 2 = 4A 7^ 0, the eigenvalues are real and repeated (we exclude the case 
with both eigenvalues equal to zero for now because that only occurs when 
the matrix of coefficients has a determinant of zero). In this case we are 
not required to have two linearly independent eigenvectors. 

If there are two linearly independent eigenvectors v and w, then the solution 
is 

y = (Av + Btw)e xt (34.61) 
and if there is only a single eigenvector v then 

y=[Av + B{tv + w)]e A * (34.62) 
where w is the generalized eigenvector satisfying (A — A/)w = v. 

In the first case (linearly independent eigenvectors) all solutions lie on 
straight lines passing through the origin, approaching the origin in posi- 
tive time (i — > oo) if A > 0, and in negative time (t — > — oo) if A < 0. 
The critical point at the origin is called a star node: a stable star if 
A = T/2 < 0 and an unstable star if A = T/2 > 0. 

If there is only a single eigenvector then the trajectories approach the origin 
tangent to v; as one moves away from the origin, the trajectories bend 
around and diverge parallel to v (see figure 34.5). The origin is called either 
a stable degenerate node (A = T/2 < 0) or an unstable degenerate 
node (A = T/2 > 0). 



385 



Figure 34.5: Phase portraits typical of an unstable star node (left) and an 
unstable degenerate node (right). The corresponding stable nodes have the 
arrows pointing so that the solutions approach the origin in positive time. 



Real Eigenvalues with Opposite Signs 

If A < 0, one eigenvalue will be positive and one eigenvalue will be negative, 
regardless of the value of T. Denote them as A and — fi, where A > 0 and 
fj, > 0. The solution is 



Solutions that start on the line through the origin with direction v (A ^ 0 
but B = 0) diverge as t — > oo and approach the origin as t — > — oo; the 
corresponding trajectory is called the stable manifold of the critical 
point. 

Solutions that start on the line through the origin with direction w ((A = 0 
with B 7^ 0) diverge as t — > — oo and approach the origin as t — > oo; the 
corresponding trajectory is called the unstable manifold of the critical 
point. Besides the stable manifold and the unstable manifold, no other 
trajectories approach the origin. The critical point itself is called a saddle 
point or saddle node (see figure 34.6). 

Example 34.4. The system 




y = Ave xt + Bwe^' 



(34.63) 




(34.64) 
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Figure 34.6: Topology of a saddle point (left) and phase portrait for example 
34.4 (right). 




lillllll 1\\VS0// ///, 
If/J^k lull L 

Wm^A f ////// 

////, 



has trace 

T = 4 - 6 = -2 (34.65) 

and determinant 

A = (4)(-6) - (1)(11) = -24 + -11 = -35 (34.66) 

Thus 

\/T 2 - 4A = v/(-2) 2 -4(-35) = VlU = 12 (34.67) 

and the eigenvalues are 

A = X - (T ± \/T 2 - 4A) = ~ 2 j 12 = 5, -7 (34.68) 

Since the eigenvalues have different signs, the origin is a saddle point. Eigen- 
vectors are ^\ (for 5) and ( (for -7). The stable manifold is the line 

y = x (corresponding to the negative eigenvalue), and the unstable mani- 
fold is the line y = — llx (corresponding the positive eigenvalue). A phase 
portrait is shown in figure 34.6. □ 
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Complex Conjugate Pair with nonzero real part. 



If 0 < T 2 < 4A the eigenvalues will be a complex conjugate pair, with real 
part T. T may be either positive or negative, but T — 0 is excluded from 
this category (if T = 0, the eigenvalues will either be purely imaginary, 
when A > 0, or real with opposite signs, if A < 0). 

Writing 

fi = T/2, uj 2 = 4A - T 2 (34.69) 

the eigenvalues become A = n±iuj, (i,u € M. Designating the correspond- 
ing eigenvectors as v and w, the solution is 



y = [Ave luJt + Bwe"^] (34.70) 

= e Mt [Av (coswi + is'mujt) + Bw (coswt — ismuit)] (34.71) 

= e Mt [pcoswi + qsinwi] (34.72) 

where 

p = Av + Bw (34.73) 

q = i(Av - Bw) (34.74) 

are purely real vectors (see exercise 6) for real initial conditions. The factor 
in parenthesis in (34.70) gives closed periodic trajectories in the xy plane, 
with period 2tt/lu; the exponential factor modulates this parameterization 
with either a continually increasing (jx > 0) or continually decreasing (/i < 
0) factor. 

When fj, > 0, the solutions spiral away from the origin as t — > oo and in 
towards the origin as t —> —oo. The origin is called an unstable spiral. 

When fj, < 0, the solutions spiral away from the origin as t — > — oo and in 
towards the origin as t — > oo; the origin is then called a stable spiral. 



Example 34.5. The system 



x 
i 



y 



-x + 2y 
-2x — 3y 



(34.75) 



has trace T = —4 and determinant A = 7; hence the eigenvalues are 
1 



A 



T ± a/T 2 - 4A =-2±iVs 



(34.76) 
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Figure 34.7: An unstable spiral node. 



which form a complex conjugate pair with negative real part. Hence the 
origin is a stable spiral center. □ 



Example 34.6. The system 

x = n.T. — n I 

(34.77) 



x = ax — y 
y' =x + ay 



where a is a small real number, has a spiral center at the origin. It is easily 
verified that the eigenvalues are A = a ± i. To get an explicit formula for 
the spiral we use the following identities: 

rr' = xx 1 + yy' (34.78) 
xy' - yx' (34.79) 



r 2 9' 



to convert the system into polar coordinates. The radial variation is 

rr' = xx' + yy' (34.80) 

= x{ax — y) + y{x + ay) (34.81) 

= a{x 2 +y 2 ) (34.82) 

= ar 2 (34.83) 



and therefore (canceling a common factor of r from both sides of the equa- 
tion) , 

r = ar (34.84) 
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The angular change is described by 

r 2 9' = xy' - yx' (34.85) 

= x(x + ay) — y(ax — y) (34.86) 

= x 2 + y 2 (34.87) 

= r 2 (34.88) 

so that (canceling the common r 2 on both sides of the equation), 

9' = 1 (34.89) 



Dividing r' by 9' gives 



and hence 



dv v 

Te = W = ar ( 34 - 9 °) 



r = r o e a ( 0 - e ^ (34.91) 
which is a logarithmic spiral with r(t 0 ) = r 0 and 9(t 0 ) = 9 Q . □ 

Purely Imaginary Eigenvalues 

If T = 0 and A > 0 the eigenvalues will be a purely imaginary conjugate 
pair A = ±iA. The solution is 

y = v cos tjt + w sin cjt (34.92) 

The origin is called a center. Center's have the unusual property (unusual 
compared to the other types of critical points we have discussed thus far) 
of being topologically unstable to variations in the equations, as illustrated 
by the following example. A system is topologically unstable if any small 
change in the system changes the geometry, e.g., the systems changes from 
one type of center to another. 



Example 34.7. The system 

x' = x 4- 2ii I 

(34.93) 



x 1 = x + 2y\ 
y' = -3a; - yj 
has a trace of T — 0 and determinant of A = 5. Thus 

1 



A =2 



T ± \/T 2 - 4A = ±iV5 (34.94) 
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Since the eigenvalues are purely imaginary, the origin is a center. 

If we perturb either of the diagonal coefficients, the eigenvalues develop a 
real part. For example, the system 



x' = 1.01a; + 2y S 



y 



-3a; 



(34.95) 



(34.96) 



has eigenvalues A f=s 0.005 ± 2.23383z, making it an unstable spiral; and the 
system 

x' = 0.99a; + 2yl 

y' = -3x - y J 

has eigenvalues A w —0.005 ± 2.2383i, for a stable spiral. 

The magnitude of the real part grows approximately linearly as the pertur- 
bation grows. In general, the perturbed system 



x' = (1 + e)x + 2y 

y' = -3s - y | 



(34.97) 



will have eigenvalues 



l r 



A =2 



e± V-20 + 4e + e 2 



2 V 5 20 



(34.98) 
(34.99) 



The results for perturbations of e — ±0.05 are shown in figure 34.8. □ 



Non-isolated Critical Points 

When the matrix A in equation (34.36) is singular, the critical points will 
not, in general, be isolated, and they will not fall into any of the categories 
that we have discussed so far. 

Set A = ad — be — 0, and suppose that all four of a, 6, c, and d are nonzero. 
Then we can solve for any one of the four coefficients in terms of the others, 
e.g., d = be/ 'a, so that the trajectories are defined by 

dy = cx + dy = ca; + (bc/a)y = c = d 
dx ax + by ax + by a b 

The trajectories are parallel lines with slope c/a. There is only one critical 
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Figure 34.8: Topological instability of center nodes. Solutions to equations 
(34.97) are plotted for epsilon=0.Q5, -0.05, -.25, 0.5, with initial conditions 
of x, y = 1,0 (black dot). The bounding box is [—2, 2] x [—2, 2] in each case. 




point, at the origin as usual. The nullclines are y = —bx/a (for x) and 
y = —(c/d)x for y (figure 34.9). At the other extreme, if all the coefficients 
are zero, then every point in the plane is a critical point and there are 
no trajectories - wherever you start, you will stay there for all time. If 
precisely one of a,6,c or d is zero, but the others are nonzero, the matrix 
will be nonsingular so the only remaining cases to consider have one or two 
coefficients nonzero. 



If a = b = 0 and c ^ 0 and/or d ^ 0, we the system becomes 

(34.101) 



aT = 01 
y' = cx + dy J 

so the solutions are all vertical lines, and every point on the line y = —cx/d 
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is a critical point (when d ^ 0), or on the line x — 0 (when d = 0). The 
directions of motion along the trajectories switch along the critical line. A 
good analogy is to think of the critical line as the top of a ridge (or the 
bottom of a valley), compared to a single apex for a nonsingular system 
(Figure 34.9). We essentially have a whole line of sources or sinks. 

By a similar argument, if c = d = 0 and a 0 and/or 6^0, the system 
becomes 

x' = ax + by j 

y' = o\ 



(34.102) 




The solutions are all horizontal lines, and there is a ridge or valley of critical 
points along the line y = ax/b (if b ^ 0) or along the line x = 0 (if b = 0). 

If a = c = 0 with b 0 and d ^ 0, the system is 



(34.103) 



The x-axis (the line y = 0) is a critical ridge (valley) and the trajectories 
are parallel lines with slope d/b. Similarly, if b = d = 0 with a ^ 0 and 
d 0 the system is 

x' = ax I , 

(34.104) 

y = ayj 

so that the trajectories are parallel lines with slope c/a and the y-axis is a 



393 



Figure 34.10: phase portraits for the system (34.101); every point on the 
entire "ridge" line is a critical point. 
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Appendix A 

Table of Integrals 



Basic Forms 



/ x n dx=^x n+1 (A.l) 

J^dx = lnx (A.2) 

J udv = uv — J vdu (A. 3) 
f 1 1 

/ -dx = -In lax + 61 (A.4) 

J ax + b a 



Integrals of Rational Functions 



i) 2 x + a 



\n+l 



f (x + a) n dx = ^ + ^ +c,n^-l (A.6) 

/* , x nj (x + a)" +1 ((n + l)x-a) 

/ x(x + a)"dx = / ^ '- (A. 7) 

J 1 ^ (n+l)(n + 2) v ; 
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[ — l —^rdx = tan 1 x (A. 8) 

J l + x 2 K ' 

[ „ 1 0 dx = - tan' 1 - (A.9) 
J a 2 + x 2 a a 

/x 1 
— -dx = -In la 2 + x 2 \ + c (A.10) 
a 2 + x 2 



x 2 i x 



a 2 + x 2 



dx = x — atan 1 — (A. 11) 



dx= l x 2 --a 2 \n\a 2 +x 2 \ (A.12) 
a 2 + x 2 2 2 



-dx=—= tan' 1 (A.13) 



ax 2 + bx + c \fiac - b 2 \fiac - b 2 



1 ; 1 , a + x 

dx=- In- , a^b (A. 14) 



/ 



(x + a) (x + b) b — a b + x ' 



x a 

-. r^dx = hlnla + xl (A. 15) 

(x + a) 2 a + x 



-dx = In lax 2 + bx + c\ 



ax 2 + bx + c 2a 



b i 2ax + b 

a V 4ac - b 2 V 4ac - b 2 

Integrals with Roots 

J y/x^adx =\{x- af' 2 (A.17) 

/ 1 dx = 2^/x + a (A.18) 
J \Jx ± a 

[ - 1 cfc = -2Va - x (A.19) 
J \Ja - x 
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/2 2 
x\/x - adx = -a(x - a) 3/2 + -(x - a) 5/2 

J \Jax + bdx = + Vax + b 

J (ax + bf/ 2 dx = ^-(ax + bf/ 2 



x 2 

dx = -(x =F 2a)\Jx ± a 
i/cc ± a 3 



// ^ > \ -i \/ x ( a ~ x ) 
a/ a.T = — \J x(a — x) — atan — 
V a — x ' x — a 



(A.20) 
(A.21) 
(A.22) 
(A.23) 

(A.24) 



/a — - — dx = \/x(a + x) — a In \y/x + \J x + a\ (A. 25) 

V a + x 



xVax + bdx = -—r(-2b 2 + abx + 3a 2 x 2 )Vax + b (A. 26) 

15cr 



J \Jx(ax + b)dx = - ^ 2 (2ax + b) \J ax(ax + b) 



4a 3/2 

-b 2 In a\fx + \J a (ax + b) 



(A.27) 



\J x 3 (ax + b)dx 



b b 2 



12a 8a 2 x 3 



y x 3 (ax + b) 



6 3 , 
+ 8^ ln 



ayjx + \Ja(ax + b) (A.28) 



/ 



\/x 2 ~±~a 2 dx = \x\J x 2 ± a 2 ± ^a 2 In 



• + V^ 2 ± a 2 



(A.29) 
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\J a 2 — x 2 dx = -x\/ a 2 — x 2 + -a 2 tan 1 
2 2 

J x\J x 2 ± a 2 dx = ^ (x 2 ± a 2 ) 



a 2 — a; 2 



3/2 



±a 2 



zdrr = In 



X + V'a; 2 ± a 2 



/ dx = sin 1 



Va; 2 ± a' 



= \J x 2 ± a 2 



/ 



/-dx = -x\J x 2 ± a 2 =F -a 2 In a; + a/ 2 : 2 ± ° 2 
Vx 2 ± a 2 2 T 2 



(A.30) 

(A.31) 
(A.32) 
(A.33) 
(A.34) 
(A.35) 

(A.36) 



/ 



\/ ax 2 + bx + cdx = - — A \J ax 2 + bx + c 
4a 



+ 



4ac - b 2 
8a 3 / 2 



In 



2ax + 6 + 2 v /a(aa; 2 + &x+c) (A.37) 



/x\J ax 2 + bx + c = — ^— — ( 2Ja\/ ax 2 + bx + c 
48a 5 / 2 V 

- (36 2 + 2a6x + 8a(c + ax 2 )) 

+3(b 3 - Aabc) In b + 2ax + 2^a\] ax 2 + bx + x ) 



(A.38) 



/ 



dx = In 



V ax 2 + bx + c \fa 



2ax + b + 2 v /a(a.x 2 + bx + c) (A.39) 
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x I / 

dx = - V ax 2 + bx + c 
V ax 2 + bx + c a 

In 2ax + b + 2Ja(ax 2 + bx + c) (A.40) 

1a A l 2 

,lV (A.41) 



( a 2 + 3.2)3/2 fl2 y^2^2 

Integrals with Logarithms 



J In axdx = x In ax — x (A. 42) 

/In ax , 1 ,2 , » ,„n 
dx = - (In ax) (A.43) 
X z 

J ln(ax + 6)dx = ^x + ln(ax + 6) - x, a ^ 0 (A.44) 

y In (x 2 + a 2 ) dx = x In (x 2 + a 2 ) - 2x + 2a tan" 1 ^ (A.45) 

/ In (x 2 - b 2 ) dx = x In (x 2 - 6 2 ) - 2x + a In (A.46) 
j x a 

/In (ax 2 + fox + c) dx = — \J 4ac — b 2 tan -1 . — 
V ; a V4ac - 6 2 

- 2x+ ^ +x^j In (ax 2 + bx + c) (A.47) 

/bx 1 If b 2 \ 
x ln(ax + 6)dx = -x 2 + - fx 2 -\ ln(ax + b) (A.48) 
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J x\n{a 2 - b 2 x 2 ) dx = - l -x 2 + \{x 2 - ^) In {<r b 2 .r 2 ) ! \.4<)) 



Integrals with Exponentials 



J e ax dx = ^e ax (A.50) 



f Jxe ax dx = -Jxe ax + -^^erf (iJax) , 
J a 2a i ' z v ' 

where erf(x) = —j= I e * dt (A. 51) 
V 71 " Jo 

J xe x dx = (x - l)e x (A.52) 

J xe ax dx = - ^) e aX (A.53) 

y jcVda; = (x 2 - 2a; + 2) (A.54) 

/ zV^z = f — - -% + A ^ e - (A.55) 
7 \ a a z a A J 

J x 3 e x dx = (x 3 - 3x 2 + 6x - 6) e x (A.56) 

/ r n ax r 

x n e ax dx = — / x n - x e ax Ax (A.57) 



J x n e ax dx = r[l + n, -ax], 

where T(a,x) = / i" - ^ - * dt 

J X 



(A.58) 
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f e ax2 dx = -^Lerf (ixJa) 
J %Va 

[ e- ax2 dx= /Jerf(x^) 
J 2V« 

[ xe- ax2 dx=--^e- ax2 
Integrals with Trigonometric Functions 



/ 



sin axdx = — — cos ax 
a 



I 



. 2 x sin2ax 

sin axdx — — 

2 4a 



/ 



sin™ axdx = — cos ax 2-F1 
a 



1 l-n 3 



2' 2 ' 2 



, cos ax 



/- 



sin axdx = — 



3 cos ax cos 3ax 
+ 



4a 



12a 



/ 



/ 



cos axdx — - sin ax 
a 

x sin 2ax 



cos axdx = — + 



(A.59) 
(A.60) 
(A.61) 
(A.62) 



4a 



(A.63) 
(A.64) 

(A.65) 

(A.66) 
(A.67) 
(A.68) 



/ 



cos p axdx 



1 



a(l+p) 



cos 1+p ax x 2 F\ 



l+p 1 3+p 



2 ' 2 ' 2 



cos ax 



/ 



cos 3 axdx 



3 sin ax sin 3ax 
4a f 12a 



(A.69) 
(A.70) 
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I 



. cos(a-6)x cos(a + o)x . , ,, „, 

cos ax sin bxdx = — — — — — — , a/o A. 71) 

2(a-b) 2(a + b) ' r v ; 



/ 



sin 2 ax cos bxdx = — 



sin[(2a — b)x\ sin ax sin[(2a + b)x] 



4(2a- 6) 26 4(2a + b) 



(A.72) 



sin 2 x cos xdx — — sin 3 x 



(A.73) 



/ 



2 . cos[(2a — b)x] cosbx 

cos si sin bxdx = — , — 

4(2a - b) 2b 

cos[(2a + b)x] 



I 



4(2a + 6) 



cos 2 ax sin axdx = — — cos 3 ax 
3a 



(A.74) 
(A.75) 



/ 



sin ax cos bxdx 



+ 



x sin2ax sin[2(a — b)x] 
4 8a 16(a - 6) 

sin 2bx sin[2(a + b)x] 



8b 



/- 



sin 2 ax cos 2 axdx = 



16(a + &) 



a; sin Aax 



8 32a 



/ 



tan axdx — In cos ax 

a 



tan axdx = —x H — tan ax 
a 



(A.76) 

(A.77) 
(A.78) 
(A.79) 



/ 



tan™ +1 ax 

tan axdx = — ; — x 2 ^i 

a(l + n) 



-— ,1,— -,- tan 2 ax (A.80) 



/ 



, , 1, 1 2 

tan axdx — - In cos ax + — sec ax 
a 2a 



sec xdx = In I sec x + tan xl = 2 tanh 



/ 



sec axdx = - tan ax 
a 



J 



1 



1 



sec x dx = - sec x tan a; + - In I sec x + tan xl 



/ 



sec x tan xdx = sec x 



sec 2 x tan xdx = - sec 2 x 



I 



sec" x tan xdx = — sec™ 1,115/0 
n 



/ 



esc xdx = In 



tan - 
2 



= In I esc x — cotxl 



/ 



esc 2 axdx — cot ax 

a 



r s , 1 1 , 

esc xdx = — - cot x esc x + - In | esc x — cot x| 



/esc" 

/ 



x cot xdx = esc™ x, n 7^ 0 



sec x esc xdx = In I tan x| 



APPENDIX A. TABLE OF INTEGRALS 
Products of Trigonometric Functions and Monomials 



J x cos xdx = cos x + x sin x (A. 93) 

/l x 

x cos axdx = cos ax H — sin ax (A. 94) 
a 2 a 

/x*cosx,ix = 2xcosx + (x*-2)sinx (A.95) 

/ 2 , 2x cos ax a 2 x 2 — 2 . 

x cos axdx— = 1 smax (A. 96) 
a z a 6 

f x n cosxdx = -^(t) n+1 [T(n + l,-ix) + {-l) n r(n + l,ix)] (A.97) 

x n cosaxdx = \{iaf~ n [{-l) n T(n + 1, -iax) - T(n + 1, ixa)] (A.98) 

y x sin xdx = — a; cos x + sin x (A. 99) 

/x cos ax sin ax , . 

xsmaxdx = 1 = — (A. 100) 
a a 2 

/x 2 sWx=(2- 2 )cosx + 2xsinx (A.101) 

/2 • > 2 — a 2 x 2 2xsinax , . „„. 

x sin axdx — cosaxH (A. 102) 
a J a 2 

I" x"sinxdx = -^(i)"[r(n + l,-ix)-(-l) n r(n + l,-ix)] (A.103) 
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Products of Trigonometric Functions and Exponentials 



J e x sinxdx = ^e x {smx — cosx) 



e bx sin axdx 



;e bx (b sin ax — a cos ax) 



a 2 + b 2 

J e x cos xdx — ^e x (sin x + cosx) 



e bx cos axdx = — r^,e bx (a sin ax + b cos ax) 

a z + b l 



xe x sin xdx — - e x (cos x — x cos x + x sin x) 



I 
I 



J xe x cosxdx — je I (icosi — sinx + xsinx) 



Integrals of Hyperbolic Functions 



(A.104) 
(A.105) 
(A.106) 
(A.107) 
(A. 108) 
(A.109) 



/ 



cosh axdx = - sinh ax 
a 



(A.110) 



/ 



e ax cosh bxdx 



-t, 77f \a cosh bx — b sinh bx] a^b 

a 1 — b z 

e 2ax x 

a = b 



I 



4a 2 
sinh axdx 



cosh ax 



(A.lll) 



(A.112) 



e ax sinh bxdx = < 



a 2 -b 2 
e 2ax x 

~4a~ ~ 2 



[—b cosh bx + a sinh bx] a ^ b 
a = b 



(A.113) 
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( e (a+2b)a 



e ax tanh bxdx = < 



(a + 26) 



1 



a a 
1+ 26' 1 ' 2+ 26'- e 



2bx 



' o ax TP 



e aa; - 2 tan" 1 [e ax 



2b 



,l,lE,-e 



lbs 



a^b 

a = b 
(A.114) 



/ 



tanh ax dx = - In cosh ax 
a 



(A.115) 



/ 



cos ax cosh bxdx = —= — \a sin ax cosh bx + b cos ax sinh bx] (A. 1 16) 

a z + b z 



1 



cos ax sinh bxdx = - [6 cos ax cosh bx + a sin ax sinh 6x] (A. 1 17) 
a z + tr 



/sin ax cosh 6xdx = „ - ,„ [—a cos ax cosh bx + b sin ax sinh 6x1 (A. 1 18) 
a z + b z 



I 



sin ax sinh 6xdx = — — [b cosh ax sin ax — a cos ax sinh 6x] (A. 1 19) 

a z + b z 



I 



sinh ax cosh axdx = 



-2ax + sinh2ax 
4a" 



(A.120) 



/ 



, , , 6 cosh 6x sinh ax — a cosh ax sinh bx , . 

smh ax cosh 6xdx = » (A. 121) 

6^ - a z 



Appendix B 

Table of Laplace 
Transforms 



/(*) mt)\ = f(s) 

-. 

e at .f(t) F(s - a) (2) 

U{t-a) — (3) 

f(t - a)U(t - a) e- as F(s) (4) 

S(t) 1 (5) 

8(t - 1 0 ) e- st ° (6) 

t n f(t) (7) 

/'(*) sF(s)-f(0) (8) 

f n (t) s n F(s) - s^-Vf(0) / ( " _1) (0) (9) 
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APPENDIX B. TABLE OF LAPLACE TRANSFORMS 



/ f{x)g{t-x)da 
Jo 

t n (n e Z) 
i x (i>-lg R) 
sin fcf 
cos kt 

e at 

sinh fci 
cosh kt 



e at _ e bt 

a — b 



F(s)G(s) 



ae" 



-be bt 



a — b 



te a 



t n e a 



e sin kt 



e at cos kt 



e at sinh kt 



s n+l 

r(x + i) 

s x+l 

k 

s 2 + k 2 
s 

s 2 + k 2 
1 



s — a 
fc 

s 2 — fc 2 
s 

s 2 — k 2 



(s 


-a)(s-b) 




s 


(s 


-a)(s-b) 




1 


(s 


-a) 2 




n\ 


(s 


- 0)™+! 




k 


(s 


- a) 2 + k 2 




s — a 


(s 


- a) 2 + k 2 




k 


(s 


- a) 2 - k 2 



(10) 

(11) 

(12) 

(13) 
(14) 

(15) 

(16) 
(17) 

(18) 

(19) 

(20) 

(21) 

(22) 

(23) 

(24) 
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e at coahkt 5 .° (25) 

(s — a) z — k 

2ks 

+ (26) 

'«»** (^TW (27) 

tsinhfct (g2 _ fc2)2 (28) 

ic ° shfc * (s s 2 r fc2)2 (29) 

sin at a 

— - — arctan - (30) 



APPENDIX B. TABLE OF LAPLACE TRANSFORMS 



Appendix C 

Summary of Methods 



First Order Linear Equations 

Equations of the form y' + p(t)y = q(t) have the solution 

V(!) = -7«( C + I V{s)q{s)ds 



where 

/j,(t) = exp 



Exact Equations 

An differential equation 

M(t,y)dt + N(t,y)dy = 0 

is exact if 

dM _ ON 
dy dt 

in which case the solution is a <j){i) = C where 

M= W N =Ty 



<(>(t,y) = j Mdt + j ' (n- j ^d?j dy 
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APPENDIX C. SUMMARY OF METHODS 



Integrating Factors 

An integrating factor \x for the differential equation 
M(t,y)dt + N(t,y)dy = 0 

sSit isfics 

d(n(t,y)M(t,y)) = d(fi(t,y)N(t,y)) 
dy dt 

If 

P(t,y) = ^ 



N 

is only a function of t (and not of y) then ^(t) — e$ p (*) d * is an integrating 
factor. If 

<*.»>- ^ 

is only a function of y (and not of t) then fi(t) = e-l is an integrating 
factor. 



Homogeneous Equations 

An equation is homogeneous if has the form 

y' - f(y/t) 

To solve a homogeneous equation, make the substitution y — tz and rear- 
range the equation; the result is separable: 

dz dt 
F(z) - z ~ T 

Bernoulli Equations 

A Bernoulli equation has the form 

yi(t)+p(t)y = q(t)y n 
for some number n. To solve a Bernoulli equation, make the substitution 

u = y x - n 
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The resulting equation is linear and 



y(t) = 

where 



i ( n / ; -- />)'/(/>'// 



>Lt(t) = cxp ^(1 - n) J p(t)dt 



l/(l-n) 



Second Order Homogeneous Linear Equation with Con- 
stant Coefficients 

To solve the differential equation 

ay" + by' + cy = 0 
find the roots of the characteristic equation 

ar 2 + br + c = 0 
If the roots (real or complex) are distinct, then 

y = Ae rit + Be r2t 
If the roots are repeated then 

y = (A + Bt)e rt 

Method of Undetermined Coefficients 

To solve the differential equation 

ay" + by' + cy = f(t) 

where /(f) is a polynomial, exponential, or trigonometric function, or any 
product thereof, the solution is 

V = Vh + VP 

where yn is the complete solution of the homogeneous equation 

ay" + by' + cy = 0 
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APPENDIX C. SUMMARY OF METHODS 



To find yp make an educated guess based on the form form of fit). The 
educated guess should be the product 

VP = P(t)S(t)E(t) 

where P(t) is a polynomial of the same order as in f(t). S(t) = r n (As'mrt+ 
B cos rt) is present only if there are trig functions in rt in f(t), and n is the 
multiplicity of r as a root of the characteristic equation (n = 0 if r is not a 
root). E(t) — r n e rt is present only if there is an exponential in rt in f(t). 
If f(t) = fi(t) + f 2 {t) H then solve each of the equations 

ay" + by' + cy = fi(t) 

separately and add all of the particular solutions together to get the com- 
plete particular solution. 



General Non-homogeneous Linear Equation with Con- 
stant Coefficients 

To solve 

ay" + by' + cy = f(t) 
where a, b, c arc constants for a general function f(t), the solution is 

y = Ae rit + Be rit J^ ri sds + ^ J/^ 3 f/ ^" ^ u ) duds 

where n and r 2 are the roots of ar 2 + br + c = 0. 

An alternative method is to factor the equation into the form 

(D-n)(D-r 2 )y = f(t) 

and make the substitution 

z = (D — r 2 )y 

This reduces the second order equation in y to a first order linear equation 
in z. Solve the equation 

(D- n )z = f(t) 

for z, then solve the equation 

(D - r 2 )y = z 
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for y once z is known. 

Method of Reduction of Order 

If one solution y\ is known for the differential equation 

y" + p(t)y' + q{t)y = 0 
then a second solution is given by 

V2(t) = yi{t) J dt 

where the Wronskian is given by Abel's formula 



W( yi ,y 2 ){t) = Cexp ^- J p(s)ds 



Method of Variation of Parameters 

To find a particular solution to 

y" +p(t)y' + q(t)y = r{t) 
when a pair of linearly independent solutions to the homogeneous equation 

y" + p(t)y' + q{t)y = 0 

are already known, 

/ \ f V2(s)r(a) , , . f yi(s)r(s) 
JtW(y 1 ,y 2 )(s) J t W(yi,y 2 )(s) 

Power Series Solution 

To solve 

y" + P{t)y' + q(t)y = g(t) 

expand y, p, q and g in power series about ordinary (non-singular) points 
and determine the coefficients by applying linear independence to the pow- 
ers of t. 
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To solve 

a{t)y" + b(t)y' + c(t)y = g(t) 

about a point to where a(t) = 0 but the limits b(t)/a(t) and c(t)/a(t) exist 
as t — > 0 (a regular singularity), solve the indicial equation 

r(r - 1) + rp Q + q Q = 0 

for r where po = \im t ^o b(to)/a(to) and and go = lim^o c(to)/a(to). Then 
one solution to the homogeneous equation is 

oo 

y(t) = (i-to) r $> fc (i-i 0 ) fc 

fc=0 

for some unknown coefficients Cfc. Determine the coefficients by linear inde- 
pendance of the powers of t. The second solution is found by reduction of 
order and the particular solution by variation of parameters. 

Method of Frobenius 

To solve 

(t - t 0 ) 2 y" + (f - t Q )p(t)y' + q(t)y = 0 

where p and q are analytic at t 0 , let p 0 — p(0) and q 0 = q(0) and find the 
roots a\ > a 2 of 

a 2 + (Po - l)a + <?o = 0 
Define A = ai — a 2 . Then for some unknowns a first solution is 

oo 

- (t-io) ai ^c fe (t-i 0 ) fe 

fe=0 

If A e M is not an integer or the roots are complex, 

oo 

y2(t) = {t-tv) a *Y. a ^ t - t *) k 

k=0 

oo 

If ai = a 2 = a, then y 2 = aj/i(t) In |t — * 0 | + (* — *o) Q afc(* - t 0 ) k 

fc=0 

oo 

If AeZ, then y 2 =ay 1 (t)\n\t-t 0 \ + (t-t 0 ) a2 J2 a k(t-to) k 

k=0 
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